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^ Image processing apparatus that can provide image data of high quality without deterioration in 
picture quality. 



) Digital image data obtained by A/D converting 
an output signal from an image sensing device 
(1) by an A/D conversion circuit (3) is converted 
Into image data con-esponding to a predeter- 
mined image fonmat by a digital process of an 
image conversion circuit (5). Therefore, an Im- 
age of higher quality without deterioration in 
the picture can be provided in comparison with 
the case where digital image data obtained by 
A/D converting an output signal from an image 
sensing device (1) is first converted into analog 
video data and then into A/D data. 
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BACKGROUND OF THE INVENTION 

Field of the Invention 

The present invention relates to image process- 
ing apparatuses, and more particularly, to an image 
processing apparatus suitable for computer systems 
such as a personal computer and a work station, do- 
mestic information terminals such as a HA (Home Au- 
tomation) system and portable information terminals, 
and also communication systems of television tele- 
phones and television conferences. 

Description of the Background Art 

A conventional image processing apparatus 
compresses image data by converting a video signal 
from a video movie camera or the like into an inter- 
mediate format called a GIF (Common Intermediate 
Format). The compressed image data is transmitted 
to the other side via a telephone line. 

Such an image processing apparatus will be de- 
scribed hereinafter with reference to Fig. 71 showing 
a structure of a conventional image processing appa- 
ratus. 

Refenring to Fig. 71, an Image processing appa- 
ratus includes a video movie 201, an A/D converter 
202, a luminance signal processing circuit 203, a color 
signal processing circuit 204, an image conversion 
circuit 205, and a frame menrwry 206. 

An analog video signal or a YC separation signal 
from video movie 201 is converted into a digital video 
signal by A/D converter 202. Digital luminance signal 
Y and digital color signal C of the digital video signal 
are processed by luminance signal processing circuit 
203 and color signal processing circuit 204, respec- 
tively, to be provided to image conversion circuit 205. 
The digital video signals processed by each of proc- 
essing circuits 203 and 204 are stored in frame mem- 
ory 206 via image conversion circuit 205. Image con- 
version circuit 205 reads out the digital video signal 
stored in frame memory 206 to convert the same into 
a GIF format by applying frame frequency conver- 
sion, line conversion, and pixel conversion thereto. 
Such a conventional image processing apparatus is 
disclosed in for example, Japanese Patent Laying- 
Open Nos. 4-229789 and 4-185087. 

Because such a conventional image processing 
apparatus has to carry out complicated frame fre- 
quency conversion, pixel conversion, and line conver- 
sion, the circuit complexity thereof is increased. 
There was also a problem that a frame memory is re- 
quired. Furthermore, when an arbitrary image format 
conversion is to be carried out, the storage capacity 
required for the frame memory is increased, resulting 
in greater circuit complexity. When compressed im- 
age data is to be generated by skipping the image 
data, the converted image is reduced in size, and 



there was a possibility of distortion in the resulting im- 
age. 

SUMf^ARY OF THE INVENTION 

5 

An object of the present invention is to provide an 
image processing apparatus that can provide image 
data of high quality without increasing memory ca- 
pacity and circuit complexity. 

10 An image processing apparatus according to an 

aspect of the present invention includes an image sig- 
nal output unit for converting image sensed light inci- 
dent from an object into a d igital image signal and out- 
putting the image signal, a signal processing circuit 

15 for applying signal process on the digital image signal 
to output a digital video signal, and a conversion cir- 
cuit for converting the digital video signal into image 
data corresponding to a predetermined image fonriat. 
According to the above-described structure, im- 

20 age sensed light incident from an object Is directly 
converted into a digital image signal, the converted 
digital innage signal is subjected to a signal process 
to be converted into a digital video signal, and then 
further converted into image data corresponding to a 

25 predetermined image format. Therefore, the memory 
capacity and the circuit complexity are not increased, 
and image data of high quality can be output. 

An image processing apparatus according to an- 
other aspect of the present invention includes: an im- 

30 age signal output unit for converting image sensed 
light incident from an object into a digital image signal 
and outputting the same; a memory for storing pro- 
gram data corresponding to a predetermined video 
system; and a signal processing logic circuit that can 

35 have an arbitrary logic programmed. The signal proc- 
essing logic circuit has a predetermined logic pro- 
grammed according to program data stored in the 
memory, and converts a digital image signal into a 
digital video signal of a predetermined video system. 

40 According to the above-described structure, an 

arbitrary logic can be programmed in a signal proc- 
essing logic circuit, and a digital image signal can be 
converted into a digital video signal con-esponding to 
a desired video system to be output. As a result the 

45 storage capacity and the circuit complexity are not in- 
creased, and image data of high quality can be out- 
put 

An image processing apparatus according to a 
further aspect of the present invention includes: an 

50 image signal output unit for converting image sensed 
light incident from an object into a digital image signal 
to output the same; an input unit for applying program 
data corresponding to a predetermined video system 
input from an external device into a main body of the 

55 apparatus; and a signal processing logic circuit that 
can have an arbitrary logic programmed. The signal 
processing logic circuit has a predetermined logic pro- 
grammed according to program data in put from an ex- 
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ternal device via the input unit, and a digital innage sig- 
nal is converted into a digital video signal correspond- 
ing to the predeternnined video system to be output. 

According to the above-described structure, an 
arbitrary logic can be programmed in a signal proc- 5 
essing logic circuit from an external device, and a dig- 
ital image signal is converted into a digital video signal 
according to a desired video system to be output As 
a result, image data of high quality can be output with- 
out increasing storage capacity and circuit complexi- io 

ty- 

The foregoing and other objects, features, as- 
pects and advantages of the present invention will be- 
come more apparent from the following detailed de- 
scription of the present invention when taken In con- 15 
junction with the accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram showing a structure of 20 
an image processing apparatus according to a first 
embodiment of the present invention. 

Fig. 2 is a block diagram showing a structure of 
a first specific example of the image conversion cir- 
cuit of Fig. 1. 25 

Figs. 3 and 4 are block diagrams showing a struc- 
ture of the main components of an image processing 
apparatus according to a second embodiment and a 
third embodiment, respectively, of the present inven- 
tion. 30 

Fig. 5 is a block diagram showing a specific struc- 
ture of the main components of the image processing 
apparatus of Fig. 4. 

Fig. 6 is a block diagram showing a structure of 
the main components of an image processing appa- 35 
ratus according to a fourth embodiment of the present 
invention. 

Fig. 7 Is a block diagram showing a specific struc- 
ture of the main components of the image processing 
apparatus of Fig. 6. 40 

Fig. 8 is a diagram for describing the center coor- 
dinates Pc of a face. 

Fig. 9 is a block diagram showing a structure of 
an image conversion circuit of an image processing 
apparatus according to a fifth embodiment of the 45 
present invention. 

Fig. 1 0 is a block diagram showing a first specific 
example of a data 1/2 conversion circuit of Fig. 9. 

Figs. 11 and 12 are first and second timing charts 
for describing the operation of the data 1/2 conversion 50 
circuit of Fig. 10. 

Fig, 13 is a block diagram showing a second spe- 
cific structure of the data 1/2 conversion circuit of Fig. 
9. 

Fig. 14 is a timing chart for describing the opera- 55 
tion of the data 1/2 conversion circuit of Fig. 13. 

Fig. 15 is a block diagram showing a structure of 
an image conversion circuit of an image processing 



apparatus according to a sixth embodiment of the 
present invention. 

Fig. 16 is a block diagram showing a structure of 
an SIF conversion circuit of Fig. 15. 

Fig. 17 is a timing chart for describing the opera- 
tion of the SIF conversion circuit of Fig. 16. 

Figs. 18 and 19 are block diagrams showing a 
structure of an image conversion circuit of an image 
processing apparatus according to a seventh erT»- 
bodiment and an eighth embodiment, respectively, of 
the present invention. 

Fig. 20 is a block diagram showing a structure of 
an image processing apparatus according to a ninth 
embodiment of the present invention. 

Fig. 21 is a block diagram showing a structure of 
an image conversion circuit of Fig. 20. 

Fig. 22 is a block diagram showing a structure of 
a vertical conversion circuit of Fig. 21. 

Fig. 23 is a timing chart for describing an opera- 
tion of the vertical conversion circuit of Fig. 22. 

Fig. 24 is a block diagram showing a structure of 
an horizontal conversion circuit of Fig. 21. 

Fig. 25 is a block diagram showing a structure of 
a calculation circuit of Fig. 24. 

Fig. 26 is a timing chart for describing the opera- 
tion of the horizontal conversion circuit of Fig. 24. 

Fig. 27 is an output timing chart of a case where 
conversion is carried out by the horizontal conversion 
circuit of Fig. 24. 

Fig. 28 is a block diagram showing a structure of 
a data control circuit. 

Fig. 29 is a block diagram showing a structure of 
an image processing circuit according to a tenth em- 
bodiment of the present invention. 

Fig. 30 is a block diagram showing a structure of 
an image conversion circuit of Fig. 29. 

Figs. 31 and 32 are first and second timing charts 
of an input signal into the image conversion circuit of 
Fig. 29. 

Figs. 33 and 34 are timing charts for describing 
a vertical conversion operation and a horizontal con- 
version operation, respectively, of the image conver- 
sion circuit of Fig. 29. 

Fig. 35 is a block diagram showing another spe- 
cific structure of the image conversion circuit of Fig. 
29. 

Fig. 36 is a timing chart for describing the opera- 
tion of a QVGA conversion circuit of Fig. 35. 

Fig. 37 is a block diagram showing a structure of 
a calculation circuit that carries out horizontal 1 /2 con- 
version. 

Fig. 38 is a block diagram showing a structure of 
a Q2VGA shown in Fig. 35. 

Figs. 39 and 40 are first and second timing 
charts, respectively, for describing the operation of 
the Q2VGA shown in Fig. 38. 

Fig. 41 is a block diagram showing a structure of 
a horizontal 1/2 calculation unit of Fig. 38. 
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Fig. 42 is a block diagram showing another spe- 
cific structure of the Q^VGA conversion circuit of Fig. 
35. 

Fig. 43 is a timing chart for describing the opera- 
tion of the Q2VGA conversion circuit of Fig. 42. 

Fig. 44 is a block diagram showing another spe- 
cific structure of the image conversion circuit of Fig. 
29. 

Fig. 45 is a block diagram showing another spe- 
cific structure of the horizontal 1/2 calculation unit of 
Fig. 38. 

Fig. 46 is a block diagram showing a structure of 
an image processing apparatus according to an elev- 
enth embodiment of the present invention. 

Fig. 47 is a flow chart for describing a control op- 
eration of an image conversion control circuit of Fig 
46. 

Figs. 48, 49 and 50 are block diagram showing a 
first, a second, and a thTrd, specific structure, respec- 
tively, of the image conversion control circuit of Fig. 
46. 

Fig. 51 is a block diagram showing a structure of 
an image processing apparatus according to a 
twelfth embodiment of the present invention. 

Fig. 52 is a flow chart for describing the control 
operation of a signal processing unit control circuit of 
Fig. 51. 

Figs. 53, 54 and 55 are block diagrams showing 
a first, a second, and a third specific structure, re- 
spectively, of the digital signal processing circuit of 
Fig. 51. 

Fig. 56 Is a block diagram showing a structure of 
an Image processing apparatus according to a thir- 
tee nth embodiment of the present invention. 

Fig. 57 is a flow chart for describing the control 
operation of the control circuit of Fig. 56. 

Fig. 58 Is a block diagram showing a structure of 
an image processing apparatus according to a four- 
teenth embodiment of the present invention. 

Figs. 59, 60, and 61 are block diagrams showing 
a first, a second, and a third specific structure, re- 
spectively, of the image processing apparatus shown 
in Fig. 58. 

Figs. 62 and 63 are block diagrams showing a 
structure of an image processing apparatus of a fif- 
teenth embodiment and a sixteen embodiment, re- 
spectively, of the present Invention. 

Fig. 64 Is a flow chart for describing a FPGA pro- 
gramming method of the image processing apparatus 
of Fig. 63. 

Fig. 65 is a block diagram showing a structure of 
an innage processing apparatus according to a seven- 
teenth embodiment of the present invention. 

Figs. 66 and 67 are circuit diagrams of a first and 
a second structure, respectively, of a register in a reg- 
ister unit shown in Fig. 65. 

Fig. 68 is a block diagram showing a structure of 
an image processing apparatus according to an eight- 



eenth embodiment of the present invention. 

Figs. 69 and 70 are block diagrams showing first 
and second specific structures, respectively, of the 
image processing apparatus of Fig. 68. 
5 Fig. 71 is a block diagram showing a structure of 

a conventional image processing apparatus. 

DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

10 

An image processing apparatus according to a 
first embodiment of the present invention will be de- 
scribed hereinafter 

Refenring to Fig. 1, an image processing appara- 

15 tus Includes an image sensing device 1, a pre-proc- 
essing circuit 2, an AID conversion circuit 3, a video 
signal processing circuit 4, an Image conversion cir- 
cuit 5, a control circuit 6. and a drive circuit 7. 

Image sensing device 1 converts image sensed 

20 light captured by an internal lens (not shown) into an 
electrical signal. Pre-processing circuit 2 sample- 
holds a signal output from image sensing device 1 
and applies a process such as automatic gain control 
(AGC) on the sample-held output signal. AID conver- 

25 sion drcuit 3 converts an output signal of pre-proc- 
essing circuit 2 Into digital data in the units of pixels, 
and provides a digital image signal Dl. 

Video signal processing circuit 4 generates a lu- 
minance signal Y, and color signals R-Y, B-Y on the 

30 basis of a digital Image signal Dl output from A/D con- 
version circuit 3, and provides the same as a digital 
video signal DP. Here, video signal processing circuit 
4 carries out white balance process, gamma correc- 
tion, and the like, whereby luminance signal Y and 

35 color signals R-Y and B-Y are output as digital sig- 
nals. Hers, the color signals are output as dot sequen- 
tial color difference of R-Y/B-Y. 

Drive circuit 7 generates a pulse such as a drive 
timing pulse, a video signal synchronizing pulse, and 

40 a video signal processing pulse to control the opera- 
tion of image sensing device 1. Control circuit 6 con- 
trols the operation of A/D conversion circuit 3, video 
signal processing circuit 4, image conversion circuit 
5, and drive circuit 7. Image conversion circuit 5 con- 

45 verts luminance signal Y and color signals R-Y and B- 
Y output from video signal processing circuit 4 into im- 
age data FD of a screen size specified by control cir- 
cuit 6 which is output to an external source. The 
screen size Is externally input Into control circuit 6. 

50 A circuit that carries out conversion into a GIF for- 
mat will be described in detail hereinafter as an image 
conversion circuit A CIF format is a common video 
signal fonmaton the basis of video codec intercommu- 
nication conforming to the coding system employed in 

55 H.261 or the like. A luminance sample of a CIF format 
Is arranged in an orthogonal grid array with 352 pixels 
per line and 288 lines per frame. Each sample of the 
two color difference components Is arranged In an or- 
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thogonal grid array with 176 pixels per line and 144 
lines per frame. The above-described image region 
has an aspect ratio of 4:3, and matches the valid 
screen of a standard television signal. The number of 
frames per second is 30. 5 

A CIF format conversion will be described here- 
inafter using an Image sensing device of 320000 pix- 
els. Here, the number of pixels of the image sensing 
device is 512(H) x 582(V). 

According to control circuit 6 and drive circuit 7, io 
a non-interlaced read out electrical signal is output 
from image sensing device 1. This electrical signal is 
converted into a digital video signal DP by pre-proc- 
essing circuit 2, A/D conversion circuit 3, and video 
signal processing circuit 4, whereby luminance data is 
and color data (dot sequential color difference) of 
512(H) X 291 (V) pixels are obtained. Image conver- 
sion circuit 5 generates image data FD of 352(H) x 
288{V) pixels corresponding to a CIF format accord- 
ing to the obtained luminance data and color data. 20 

The above image conversion circuit w^lll be de- 
scribed In detail with reference to Fig. 2. Referring to 
Fig. 2, an image conversion circuit Includes a line 
processing unit 51 , a horizontal luminance processing 
unit 52, and a horizontal color processing unit 53. Hor- 25 
izontal luminance processing unit 52 includes a shift 
circuit 521, a luminance memory circuit 522, a lumi- 
nance skipping unit 523, a luminance buffer circuit 

524, and a luminance FIFO (First-ln and First-Out) 

525. Horizontal color processing unit 53 includes a 30 
shift circuit 531, a color memory circuit 532, a color 
skipping unit 533, a color buffer circuit 534, and a col- 
or FIFO 535. 

First, line processing unit 51 dicards 3 lines of 
data from the luminance data and the color data of 35 
291 lines to result In data of 288 lines. This conversion 
can be realized by, for example, providing an Internal 
counter to count a line synchronizing signal, and mak- 
ing valid only data of 288 lines. 

Then, for each of the 288 lines of Image data out- 40 
put from line processing unit 51, a skipping process 
in the horizontal direction is carried out for each line. 
More specifically, the luminance data Is converted 
from 512 pixels to 352 pixels, and each color data is 
converted from 256 pixels to 176 pixels. 45 

As to this conversion process, first the operation 
of horizontal luminance processing unit 52 will be de- 
scribed. Here, luminance data Yin is applied to a skip- 
ping process for every 32 pixels to generate data of 
22 pixels. First, an input luminance data Yin is shifted 50 
by 1 clock by shift circuit 521 in synchronization with 
a clock CLK1 . When 32 pixels are shifted, the shifted 
luminance data Yin is stored into luminance memory 
circuit 522 in synchronization with a clock CLK1/32. 
Luminance skipping unit 523 converts luminance 55 
data Y0-Y31 of 32 pixels Into luminance data Y'O-Y'21 
of 22 pixels as set forth in the following. 
Y'O = YO 



ri = Y1 + Y2 

Y'2 = Y3 

Y'3 = Y4 + Y5 

Y'4 = Y6 

Y'5 = Y7 + Y8 

Y'6 = Y8 + Y9 

Y7 = Y10 + Y11 

Y'8 = Y11 + Y12 

Y'9 = Y13 

riO = Y14 + Y15 

Y'11 = Y16 

Y'12 = Y17 + Y18 

Y'13 = Y19 

Y'14==Y20 + Y21 

ri5 = Y22 

Y*16 = Y23 + Y24 

Y'17 = Y24 + Y25 

Y'18 = Y26 + Y27 

Y'19 = Y27 + Y28 

Y'20 = Y29 

Y'21 = Y30 + Y31 
By carrying the above-described conversion op- 
eration 16 times, the pixels are converted from 512 
pixels to 352 pixels, resulting in a skipping process for 
1 line. By carrying this operation for the 288 lines, im- 
age data corresponding to a CIF format can be ob- 
tained. 

The converted luminance data Y'0-Y'21 are stor- 
ed into luminance buffer circuit 524 in synchronization 
with a clock CLK1/32. Then, luminance data Y'0-Y'21 
are transferred to luminance FIFO 525, and then ex- 
ternally output as luminance data CLFYout in syn- 
chronization with a transfer clock CLK2. 

Color data is also processed by horizontal color 
processing unit 53 in parallel to the above-described 
process. Color data R-Y and B-Y input from line proc- 
essing unit 51 are respectively shifted by 16 pixels by 
shift circuit 531. The color data is stored into color 
memory circuit 532 In synchronization with clock 
CLK1/32. The stored color data R-YO-R-YIS and B- 
Y0-B-Y15 are converted into color data R-Y'0--R- 
Y*10 and B-Y'O-B-Y'10 according to the following 
skipping process, similar to luminance signal, by color 
skipping unit 533. 

(R-Y'O) = R-YO 

(R-Y'1) = R-Y2 

(R-Y'2) = R-Y3 

(R-Y*3) = R-Y4 

(R-Y'4) = R-Y6 

(R-Y'5) = R-Y7 

(R-Y'6) = R-Y9 

(R-Y7) = R-Y10 

(R-Y'8) = R-Y12 

(R-Y'9) = R-Y13 

(R-Y'10) = R-Y15 

(B-Y'O) = B-YO 

(B-Y*1) = B-Y2 

(B-Y'2) = B-Y3 
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(B-r3) = B-Y4 

{B-Y'4) = B-Y6 

{B-Y'5) = B-Y7 

{B-Y'6) = B-Y9 

(B-Y7) = B-Y10 

{B-Y'8) = B-Y12 

(B-Y'9) = B-Y13 

(B-Y'10) = B-Y15 
By carrying out the above-described conversion 
operation 16 times, the data is converted from 256 
pixels into 176 pixels, resulting in a skipping process 
of 1 line. This conversion operation is carried out only 
for the 256 pixels. By carrying out the above- 
described operation for the 288 lines, an image size 
corresponding to a CI F fomiat is obtained. 

The converted color data R-Y'0~R-Y'11 and B- 
Y'0~B-Y'11 are stored into color buffer circuit 534 in 
synchronization with clock CLK 1/32. Then, color data 
R-ro-R-ni and B-Y'0^B-Y'11 are transferred to 
color FIFO 535, and then externally output as color 
data CIFCout In synchronization with transfer clock 
CLK2. 

The luminance data and the color data processed 
as described above are output for every 1 line as a 
data pair. Thus, image conversion data correspond- 
ing to an externally specified format, for example a 
CIF format, can be output. 

An image processing apparatus according to a 
second embodiment of the present invention wilt be 
described hereinafter. 

Referring to Fig. 3, the image processing appara- 
tus of the second embodiment has a memory 8 added 
in image conversion circuit 5. Memory 8 stores field 
data (digital video data) output from video signal proc- 
essing circuit 4. In the above-described first embodi- 
ment image data is processed for every 1 field (odd 
number field or even number field), so that only 1/2 
vertical lines of 1 frame can be obtained in a non-in- 
terlace process. The second embodiment has inter- 
laced input image data converted into non-interlaced 
image data, whereby image conversion carcuit 5 con- 
verts the same Into an externally specified image for- 
mat. As a result, a maximum number of vertical lines 
of 1 frame can be obtained. The conversbn process 
of the image format is similar to that of the first enn- 
bodimenL 

An image processing apparatus according to a 
third embodiment of the present invention will t»e de- 
scribed hereinafter with reference to Fig. 4. The im- 
age processing apparatus of the third emt>odiment in- 
cludes an image detection circuit 9 in addition to the 
structure of the second embodiment. Memory 8 
stores video data. Image detection circuit 9 is a circuit 
for detecting the feature of the image of the video data 
applied from video signal processing circuit 4. For ex- 
ample, determination is made whether the image is 
mainly of a person, text, or whether it is a still picture 
or a moving picture. In the third embodiment, image 



conversion circuit 5 selects a predetermined image 
conversion method according to the determination re- 
sult of video detection circuit 9. 

A specific structure of the main components of 

5 the image processing apparatus shown in Fig. 4 will 
be described hereinafter. Referring to Fig. 5, the im- 
age processing apparatus includes a binarization 
processing circuit 91, a frame difference detection 
unit 92, a frame memory 93, an image area detection 

10 unit 94, and an image conversion circuit 5a. Image 
conversion circuit 5a includes a moving picture orient- 
ed conversion circuit 54, a person oriented conver- 
sion circuit 55, and a text oriented conversion circuit 
56. 

15 Binarization processing unit 91 converts the lumi- 

nance data of the Nth frame applied from video signal 
processing circuit 4 into binary data. The binarized 
data of the Nth frame is stored In frame memory 93 
via frame difference detection unit 92. Frame differ- 

20 ence detection unit 92 compares the binary data of 
the Nth frame stored In frame memory 93 and the 
subsequent input binary data of the (N+1 )th frame. By 
this comparison, frame difference detection unit 92 
detects whether there is movement between the 

25 frames. Next, binar y data of the (N+1 )th frame is stor- 
ed into frame memory 93. Then, the above-described 
operation is sequentially carried out. Frame differ- 
ence detection unit 92 determines whether there is 
movement in the input image. Determination is made 

30 by frame difference detection unit 92 that the image 
is a moving picture when there is movement, and a 
still picture when there is no movement. 

Image area detection unit 94 calculates the occu- 
pying area of the image on the basis of the binary data 

35 output from frame difference detection unit 92. Deter- 
mination is made by Image area detection unit 94 that 
the data is image data mainly of a person when there 
is a large image portion with respect to the image data 
of 1 frame. In contrast, if the image portion is small, 

40 determination is made that it is text data. In the case 
of a moving picture, the area detection process is not 
carried out, and determination is directly made of a 
moving picture data. 

The determination carried out by image area de- 

45 lection unit 94 is based on calculating the ratio of 
black data to white data In 1 frame using binary data 
of 1 frame binarized into either white or black. When 
black is great, a process is carried out on the assump- 
tion that it is image data mainly of a person. When 

50 white is great, a process is carried out on the assump- 
tion thai it is image data mainly of text. 

Image area detection unit 94 applies the image 
data into moving picture oriented conversion circuit 
54 of image conversion circuit 5a when determination 

55 is made of a moving image according to the above- 
described process. When determination is made of a 
still picture of a person, the image data is input into 
person oriented conversion circuit 55 in image con- 
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version circuit 5a. The image data is applied to text 
oriented conversion circuit 56 In image conversion cir- 
cuit 5a when determination is made that the image is 
a still picture and text image. Thus, the feature of the 
input image data is detected, and an image format 5 
conversion process, a filtering process, or the like is 
selected according to the determination result. Thus, 
an optimum image format conversion process is re- 
alized. 

A structure of the main components of an image io 
processing apparatus according to a fourth emt>odi- 
ment of the present invention will be described here- 
inafter with reference to Fig. 6. The image processing 
apparatus according to the fourth embodiment in- 
cludes a face tracking circuit 1 0 instead of image de- is 
tection circuit 9 of the third embodiment. The image 
data provided from video signal processing circuit 4 
is applied to face tracking circuit 10 via image conver- 
sion circuit 5. Face tracking circuit 10 extracts the 
face of a person according to the input image data. 20 
Image conversion circuit 5 generates image data of a 
screen size corresponding to an externally specified 
format, for example a CIF format, with the position of 
the extracted face as the center. 

By such a process, an image of a face that is re- 25 
duced in distortion can be transmitted effectively by 
conversion in the case where image data mainly of a 
person is transferred such as on the screen of a tel- 
evision telephone or television conference. 

A specific structure of the main component of the 30 
image processing circuit of Fig. 7 will be described. 
Referring to Fig. 7, the image processing apparatus 
includes a frame difference detection unit 101, a bi- 
narization processing unit 102, frame memories 103 
and 105, a face coordinate calculation unit 104, an im- 35 
age conversion circuit 5, and a memory 8. 

Digital video data DP input from video signal 
processing circuit 4 is applied to frame difference de- 
tection unit 101. Frame difference detection unit 101 
compares the image data stored in frame memory 40 
105 and the image data applied at the next 1 frame 
to detect the difference thereof. Frame difference de- 
tection unit 101 detects the edge of the moving por- 
tion according to the difference thereof. 

The differential data of the moving portion gen- 45 
erated by frame difference detection unit 101 is bina- 
rized by binarization processing unit 102. Binarization 
processing unit 102 applies a labeling process on the 
binary data for adjustment, and also removes noise. 
Then, face coordinate calculation unit 1 04 calculates 50 
the position data of the face portion, and specifies a 
face region. Frame memory 103 stores the image 
data of the specified region. On the basis of this face 
data, the center coordinates Pc of a face (refer to Fig. 
8) is extracted. According to the data obtained by the 55 
above-described process, image conversion circuit 5 
carries out a zooming or skipping process so that the 
entire face fits into the size of the CIF format (352 pix- 



els X 288 pixels) with the center coordinates Pc of the 
face as the center. 

By directly applying image conversion on an im- 
age signal output from an image sensing device ac- 
cording to the present invention, a natural picture with 
little distortion in the image can be obtained without 
increasing the memory capacity and the circuit com- 
plexity in comparison with the conventional case 
where image fonmat conversion is can-ied out after 
the image signal is converted into a NTCS or a PLA 
analog video signal. Also, by detecting the position of 
a face, image format conversion can be carried out 
only on a required region in which a face is extracted, 
and only the image data required for an image com- 
pression circuit or the like can be output. Therefore, 
the image data can be reduced. Furthermore, be- 
cause data other than the face that is not required is 
not output, the peripheral unrequired image in a tele- 
vision telephone or the like does not have to be trans- 
ferred. 

An image processing apparatus according to a 
fifth embodiment of the present invention will be de- 
scribed hereinafter. The following fifth-eighth em- 
bodiments are image processing apparatuses that 
can obtain image data of different formats such as 
CIF, QCIF, SIF and QSIF Also, a frame memory is not 
required, and increase in circuit complexity can be 
suppressed. 

Referring to Fig. 9, the image conversion circuit 
of the image processing apparatus of the fifth enn- 
bodiment includes a CIF conversion circuit 57, and a 
data 1/2 conversion circuit 58. The other components 
are similar to those of the first embodiment shown in 
Fig 1, and their details will not be repeated. The image 
processing apparatus of the fifth embodiment in- 
cludes CIF conversion circuit 57 for converting digital 
video data DP applied from a signal processing circuit 
4 into a CIF fonnat of 352 dots x 288 lines as shown 
in Fig. 9. At a subsequent stage of CIF conversion cir- 
cuit 57, data 1/2 conversion circuit 58 is provided as 
a format conversion circuit that converts image data 
CIF corresponding to a CIF format into image data of 
another format. More specifically, a conversion circuit 
is added that provides image data QCIF correspond- 
ing to a QCIF format of 176 dots x 144 lines by con- 
verting the horizontal information and the vertical in- 
formation of the CIF data to 1/2. 

A structure of the data 1/2 conversion circuit of 
Fig, 9 will be described with reference to Fig. 10. Re- 
ferring to Fig. 10, a data 1/2 conversion circuit in- 
cludes a dot 1/2 conversion circuit 581, a line 1/2 con- 
version circuit 582, and an output clock gate 583. 

Dot 1/2 conversion circuit 581 reduces only the 
horizontal information of image data CIF to 1/2, and 
provides a dot clock signal DCK into output clock gate 
583. Line 1/2 conversion circuit 582 reduces only the 
vertical information of image data CIF to 1/2, and pro- 
vides a line clock signal LCK to output clock gate 583. 
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Output clock gate 583 receives a timing signal DCLK 
applied to image data GIF, in addition to dot dock sig- 
nal DCK and line clock signal LCK. Timing signal 
DCLK Is a reference signal indicating an output timing 
of a dot. 5 

The operation of the image processing apparatus 
of the fifth embodiment will be described with refer- 
ence to Figs. 11 and 12. Image data GIF converted 
into a GIF format is output from GIF conversion circuit 
57 according to a timing shown in Fig. 11 . Image data io 
GIF from GIF conversion circuit 57 is applied to data 
1/2 conversion circuit 58 which is provided at a suc- 
ceeding stage of GIF conversion circuit 57. In Fig. 11, 
luminance signal Y and color signal UV are signals 
showing the luminance and color of image data GIF. i5 
Signal LSTN is a signal indicating the start of a dot 
which is the horizontal information of image data GIF. 
Signal FSTN is a signal indicating the start of a line 
which is the vertical information of Image data GIF. 
The broken line in Fig. 11 indicates the lines of 1 unit 20 
of image data GIF, i.e. the lines from line 0 to line 287. 

When image data GIF is applied to data 1/2 con- 
version circuit 58, a line clock signal LGK that is driven 
to H (logical high) and L (logical low) for every signal 
LSTN is output from line 1/2 conversion circuit 582 as 25 
shown in Fig. 12. From dot 1/2 conversion circuit 581, 
a first dot clock signal DGK1 driven to H and Lfor ev- 
ery 1 dot of a luminance signal and a second dot clock 
signal DCK2 driven to H and Lfor every 2 dots of color 
signals are respectively output Here, when the first 30 
dot clock signal DGK1 and line clock signal LGK both 
attain H, an output clock signal YWGLK according to 
timing signal DCLK is provkied from output clock gate 
583. When second dot clock signal DGK2 and line 
clock signal LGK both attain H, an output clock signal 35 
UVWGLK according to timing signal DCLK is provid- 
ed from output clock gate 583. As a result, image data 
QCIF converted into a QCIF format of 176 dots x 144 
lines is output from data 1/2 conversion circuit 58 by 
having the horizontal and vertical information of in> 40 
age data GIF respectively converted to 1/2. 

In the fifth embodiment, when data 1/2 conver- 
sion circuit 58 is not operated, image data GIF is di- 
rectly output from data 1/2 conversion circuit 58. 
Therefore, by selecting whether data 1/2 conversion 4S 
circuit 58 is to be operated or not, image data of a GIF 
format or a QCIF format can be selectively output. 

The present invention is not limited to the fifth 
embodiment in which a data 1/2 conversion circuit in- 
cluding dot 1/2 conversion circuit 581, line 1/2 conver- so 
sion circuit 583, and output clock gate 583 is em- 
ployed, and image data of a GIF format can have the 
horizontal information and the vertical infonmation 
converted to 1/2 by carrying out a calculation of taking 
the average value of two data. 55 

A second specific example of the data 1/2 con- 
version circuit of Fig. 9 will be described hereinafter 
with reference to Figs. 13-14. The present second ex- 



ample is a data 1/2 conversion circuit that carries out 
averaging by calculation. 

Referring to Fig. 13, a data 1/2 conversion circuit 
includes a line memory 584, calculation units 585 and 
587, a flipflop 586, and a data timing control circuit 
589. Line memory 584 and calculation circuit 585 
process at least the vertical information of luminance 
signal Y of image data GIF input according to the for- 
mat shown in Fig. 11. Similarly, flipflop 586 and cal- 
culation unit 587 process the horizontal information. 

Data timing control circuit 589 outputs a data en- 
able signal DE generated according to signal FSTN, 
signal LSTN and timing signal DCLK of the image 
data of the GIF format Here, line memory 584 stores 
vertical data A in the input line of 1 unit, and provides 
to calculatktn unit 585 the stored vertical data A when 
vertical data B of the next line of 1 unit is input. Cal- 
culation unit 585 merges vertical data A input from 
line memory 584 and the next directly input vertical 
data B, i.e., carries out a (A+B)/2 process. 

Flipflop 586 operates with timing signal DCLK as 
a clock signal. Calculation unit 587 merges horizontal 
data A of the line of 1 unit provided from flipflop 586 
and the next input horizontal data B of the line of 1 
unit i.e., carries out a (A+B)/2 process. As a result, a 
luminance signal of image data GIF subjected to a 1 /2 
averaging process in both the horizontal and vertical 
directbns is output from calculation unit 587. 

Data timing control circuit 589 outputs a data en- 
able signal DE that is rendered to H and to L for every 
line of 1 unit subsequent to the preceding line of 1 unit 
according to signal FSTN, and that is rendered to H 
and to L for every dot of 1 unit subsequent to the pre- 
ceding 1 unit according to signal LSTN. The period 
when data enable signal DE attains a H level is the 
active period for data entry. When data enable signal 
DE having this active period is provided together with 
the image data output from calculation unit 587, im- 
age data QCIF corresponding to a QCIF format of 176 
dots X 1 44 lines is output from the data 1/2 conversion 
circuit of the present emtwdiment, similar to that of 
the fifth embodiment. 

An image conversion circuit of an image process- 
ing apparatus according to a sixth embodiment of the 
present invention will be described hereinafter. Refer- 
ring to Fig. 15, an image conversion circuit includes 
a GIF conversion circuit 57, and a SIF conversion cir- 
cuit 59. In the sixth embodiment, conversion to a GIF 
format is carried out by reducing the image data of a 
GIF format of 352 dots x 288 lines at the top and bot- 
tom 24 lines in the vertical direction. 

The apparatus of the sixth embodiment includes 
a GIF conversion circuit 57 that converts a digital vid- 
eo signal input from a signal processing circuit into a 
GIF format of 352 dots x 288 lines, as shown in Fig. 
15. At a succeeding stage of GIF conversion circuit 
57, a SIF conversion circuit 59 that carries out format 
conversion is provided. More specifically, a conver- 
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sion circuit is provided that converts data of a GIF for- 
mat into image data SIF corresponding to a SIF for- 
mat of 352 dots X 240 lines. 

The SIF conversion circuit of Fig. 15 will be de- 
scribed hereinafter with reference to Figs. 1 6 and 17. 5 
Referring to Fig. 16, a SIF conversion circuit Includes 
a 24-line counter 591, a 240-line counter 592, and a 
line start detection unit 593. 24-Iine counter 591 de- 
lays the initiation of the vertical information process 
of the image data of the CIF format by 24 lines in the io 
SIF format conversion operation. 240-line counter 
592 detects the end of the vertical information proc- 
ess. 

When a SIF conversion is to be carried out, 24- 
line counter 591 receives signal FSTN, as shown in 15 
Fig. 17, and then counts 24 lines of the vertical data 
of image data CIF, and delays signal OFSTN as signal 
FSTN output to an external source. As a result, vert- 
ical data of 24 lines is removed. Here, 240-llne coun- 
ter 592 detects signal OFSTN output from 24-line 20 
counter 591, and counts 240 lines of the vertical data 
of the CIF format image data. Then, 24b-line counter 
592 provides to line start detection unit 593 a signal 
having an active period for indicating a fetching valid 
period of the vertical information. 25 

After detection of signal OFSTN, line start detec- 
tion unit 593 externally provides signal OLSTN which 
is obtained corresponding to signal LSTN when the 
signal output from 240-line counter 592 is active. As 
a result, inr^ge data SIF corresponding to a SIF for- 30 
mat converted into 352 dots x 240 lines is output from 
SIF conversion circuit 59. 

When SIF conversion circuit 59 of the present 
embodiment is not operated, image data correspond- 
ing to a CIF format is directly output from SIF conver- 35 
sion circuit 59. Because SIF conversion circuit 59 re- 
ceives a mode signal CIFM instructing a CIF conver- 
sion instead of a mode signal SIFM instructing a SIF 
conversion, 240-line counter 591 receiving mode sig- 
nal CIFM directly outputs the input signal FSTN. 40 
Therefore, 240-line counter 592 wilt always output an 
active signal. Therefore, image data corresponding to 
a CIF format is output without being subjected to any 
conversion process by the SIF conversion circuit. By 
selecting whether a SIF conversion circuit is to be op- 45 
erated or not according to a mode signal in the present 
embodiment, image data corresponding to a CIF for- 
mat or a SIF format can be selectively output. 

An image conversion circuit of an image process- 
ing apparatus according to a seventh embodiment of so 
the present invention will be described hereinafter 
with reference to Fig. 18. In the seventh embodiment, 
conversion is carried out on image data of a CIF for- 
mat of 352 dots X 288 lines to obtain image data QSIF 
corresponding to a QSIF format of 176 dots x 120 55 
lines. 

Referring to Fig. 18, an image conversion circuit 
includes a CIF conversion circuit 57, a SIF conversion 



circuit 59, and a data 1/2 conversion circuit 58. CIF 
conversion circuit 57 converts a digital video signal 
DP applied from a signal processing circuit into image 
data CIF of a CIF format of 352 dots x 288 lines. SIF 
conversion circuit 59 converts image data CIF of a 
CIF format into image data SIF of a SIF format of 352 
dots x 240 lines. Similar to the data 1/2 conversion cir- 
cuit of Fig. 9, data 1/2 conversion circuit 58 includes 
a dot 1/2 conversion circuit 581, a line 1/2 conversion 
circuit 582, and an output dock gate 583. 

When SIF format image data SIF is applied to 
data 1/2 conversion circuit 58 of the above-described 
structure, only the horizontal information of the SIF 
format image data is skipped to 1/2, and a dot clock 
signal is output to output clock gate 583. Also, line 1/2 
conversion circuit 582 skips only the vertical Informa- 
tion of the SIF format image data to 1/2, and provides 
a line clock signal to output clock gate 583. Because 
output clock gate 583 receives timing signal DCLK 
applied to the SIF format image data, and also a dot 
clock signal and a line dock signal, output clock sig- 
nals YWCLK and UVWCLK are provided from output 
clock gate 583, similar to the embodiment shown in 
Fig. 10. 

According to the present embodiment, image 
data QSIF of a QSIF format of 176 dots x 120 lines 
obtained by respectively converting the horizontal 
and vertical information of the SIF format image data 
to 1/2 is output from data 1/2 conversion circuit 58. 

An image processing apparatus according to an 
eighth embodiment of the present invention will be 
described hereinafter with reference to Fig. 19. Ac- 
cording to the eighth embodiment, image data SIF of 
a SIF format of 352 dots x 240 lines is obtained. Re- 
ferring to Fig. 19, a CIF/SIF conversion circuit 60 in- 
cludes a vertical conversion circuit 601 , a line conver- 
sion circuit 602, and a horizontal conversion circuit 
603. Vertical and horizontal conversion circuits 601 
and 603 have the vertical information and then the 
horizontal information of the digital video signal DP 
from a signal processing circuit converted into a CIF 
format. A line conversion circuit 602 is provided be- 
tween vertical and horizontal conversion circuits 601 
and 603. Vertical and horizontal conversion circuits 
601 and 603 form the CIF conversion circuit 57 in the 
above-described embodiments. Line conversion cir- 
cuit 602 has a function corresponding to that of SIF 
conversion circuit 59 of Fig. 15. More specifically, it 
converts the vertical data of the CIF format image 
data into 240 lines from 288 lines. 

According to the image conversion circuit of the 
above-described structure, digital video signal DP 
provided from a signal processing circuit is applied to 
vertical conversion circuit 601 forming CIF/SIF con- 
version circuit 60, whereby only the vertical data is 
converted into image data of 288 lines. Then, the im- 
age data induding the vertical information of 288 lines 
is applied to line conversion circuit 602 to be subject- 
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ed to the above-described line conversion process, 
resulting in image data having vertical data of 240 
lines. Then, the image data having vertical data of 240 
lines is applied to horizontal conversion circuit 603. 
Horizontal conversion circuit 603 converts the hori- 
zontal data into Image data of 352 dots. As a result, 
digital video signal DP applied to CIF/SIF conversion 
circuit 60 is converted into image data SIF of a SIF for- 
mat of 352 dots X 240 lines to be output. 

When line conversion circuit 602 is not operated 
in the present embodiment, CIF/SIF conversion cir- 
cuit 60 carries out only the function of a GIF conver- 
sion circuit. Therefore, digital video signal DP applied 
from a signal processing circuit is subjected to the 
conversion of only a CIF format image data. Here, inv 
age data corresponding to CIF format of 352 dots x 
288 lines is output from CIF/SIF conversion circuit 60. 
By making selection whether line conversion circuit 
602 forming CIF/SIF conversion circuit 60 is to be op- 
erated or not, image data of a CIF format or a SIF for- 
mat can be selectively output 

Because, a format conversion circuit that can 
convert Image data of a CIF fornral into image data of 
another format is added at a subsequent stage of a 
CIF conversion circuit, the CIF format image data can 
easily be converted into image data of another for- 
mat, for example a QCIF, a SIF, or a QSIF fonmat. By 
controlling the operation of the format conversion cir- 
cuit. Image data of a CIF format or another format can 
be provided from the format conversion circuit. As a 
result, a frame memory is not required in the above 
described embodiments. Image data of a desired for- 
mat can be obtained without increasing the circuit 
complexity. 

An image processing apparatus according to a 
ninth embodiment of the present invention will b>e de- 
scribed hereinafter with reference to Figs. 20. The lin- 
age processing apparatus of Fig. 20 differs from the 
image processing apparatus of Fig. 1 in that the im- 
age conversion circuit is modified into an image con- 
version circuit 5b. The remaining components are 
similar to those of the first embodiment, and the same 
components have the same reference characters de- 
noted. Their description will not be repeated. 

An image conversion circuit of Fig. 20 will be de- 
scribed hereinafter with reference to Fig. 21. The in> 
age conversion circuit includes a vertical conversion 
circuit 61 , and a horizontal conversion circuit 62. Vert- 
ical conversion circuit 61 receives digital video signal 
DP. Horizontal conversion circuit 62 is connected at 
the succeeding stage of vertical conversion circuit 61 . 

Vertical conversion circuit 61 sequentially proc- 
ess the input data, or carries out a process using the 
line memory to convert the data into a predetermined 
number of lines. Horizontal conversion circuit 62 se- 
quentially processes the input data to convert the 
data Into a predetermined number of dots. According 
to the present embodiment, data is sequentially proc- 



essed, and the data process is canried out without us- 
ing a frame memory. Because horizontal and vertical 
conversion is not carried out at once, a conversion Is 
possible without using a frame memory. 

5 A vertical and horizontal conversion process ac- 

cording to the above image conversion circuit will be 
described hereinafter. The case where one vertical 
246-line type data of a CCD (Charge Coupled Device) 
of 190000 pixels or 270000 pixels is converted into 

10 288 lines of a CIF fonmat will be described. 

First, the structure of the vertical conversion cir- 
cuit of Fig. 21 will be described. Referring to Fig. 22, 
a vertical conversion circuit includes a line memory 
control circuit 611 , a state counter 61 2, a weight gen- 

15 erator 613, a calculation circuit 614, and line memor- 
ies 615-617. 

The vertical conversion circuit of Fig. 22 converts 
the line numbers to 288 lines by converting 6 lines into 
7 lines. An approach of storing data into line memories 

20 of 6 lines and then carrying out conversion thereon is 
generally considered in converting 6 lines Into 7 lines. 
However, in the present embodiment, conversion is 
canried out with line memories of 3 lines by applying 
a 7/6 line data process at 1 horizontal period. If the 

25 2 46 lines are directly subjected to a conversion of 6 
lines to 7 lines, only 287 lines are obtained. Actually, 
the converted 287 lines and 1 blanking line are added. 
When the number of dots in the horizontal direction 
can not be divided by 7/6, the 6 lines are processed 

30 by an Integer closest to the divldable value, and entire 
adjustment may be carried out at the last seventh line. 

Line memory control circuit 611 responds to a 
control signal for horizontal synchronization applied 
from a video signal processing circuit and a dot clock 

35 indicating the timing of a dot to write the entire video 
data of 1 tine of the display period into any of line 
memories 615-617 according to the write line menr>- 
ory information provided from state counter 612. Al- 
though not shown, a digital video signal is directly pro- 

40 vided from a signal processing circuit as write data 
into each of line memories 615-617. 

The operation of the vertical conversion circuit of 
Fig. 22 will be described hereinafter. The line memory 
write shown in Fig. 23 shows to which tine memory 

45 data is written. According to the information of read 
out line memory provided from state counter 612, 
data of a plurality of or one line memory is read out. 
The line memory read shown in Fig. 23 shows from 
which line memory data is read out State counter 612 

50 counts the writing and reading state of the line mem- 
ory. 

As to the writing operation, counting from 0 to 5 
is repeated according to the horizontal synchroniza- 
tion to output six states. Also, the writing and reading 
55 are both initialized at the timing of the vertical syn- 
chronization. Here, vertical synchronization is the 
starting time point of a vertical display. As to a reading 
operation, the dot clock is counted, and when the end 
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of 1 line process is detected, count 0 to 6 is repeated 
to output seven states. 

The above-described vertical conversion circuit 
processes the 7/6 line data for one horizontal period 
to generate a signal indicating the valid timing of this 
data. In practice, a delay is considered that is gener- 
ated by having the data processed by a calculation 
circuit or the like. 

Weight generator 613 generates weight on the 
calculation according to the information provided 
fronn state counter 612. Weight generator 613 also 
generates a through signal to output the original data 
without carrying out the calculation on line 0 and line 
6 after the conversion. Calculation circuit 614 selects 
data of line memories 615-617 according to informa- 
tion provided from state counter 612, and carries out 
calculation using the weight from weight generator 
613. 

By the above-described conversion pnDcess, 
data of 6 lines is converted into data of 7 lines as de- 
scribed in the following^ and then eventually expand- 
ed to 288 lines. 

line 0 after conversion line 0 before conver- 
sion 

line 1 after conversion i— (line 1 before conver- 
sion - line 0 before conversion) x 6/7 + line 0 before 
conversion 

line 2 after conversion ^ (line 2 before conver- 
sion - line 1 before conversion) x 5/7 + line 1 t>efore 
conversion 

line 3 after conversion <r- (line 3 before conver- 
sion - line 2 before conversion) x 4/7 + line 2 before 
conversion 

line 4 after conversion <r- (line 4 before conver- 
sion - line 3 before conversion) x 3/7 + line 3 before 
conversion 

line 5 after conversion (line 5 before conver- 
sion - line 4 before conversion) x 2/7 + line 4 before 
conversion 

line 6 after conversion line 5 before conver- 
sion 

According to the above-described conversion, 
output is made in the unit of 7/6 lines, and data of 1 
continuous horizontal format will not be obtained. 
Therefore, the above- described conversion data is 
valid during the 7/6 x 1 horizontal display period out 
of the (1 horizontal display period + 1 horizontal blank- 
ing period). 

If a pipe line type calculation circuit is provided at 
a succeeding stage, a calculation process is sequen- 
tially carried out according to a dot clock. Therefore, 
the above-described discontinuous data cannot be di- 
rectly processed. However, enroneous operation can 
be prevented by processing the data valid timing to 
suppress provision of a clock to calculation circuit 
614. 

The case of converting 512-dot type data such as 
a CCD of 270000 pixels or 320000 pixels into 352 dots 



of a GIF format will be described hereinafter. The hor- 
izontal conversion circuit of Fig. 24 carries out the 
above-described conversion operation by converting 
16 dots into 11 dots. Referring to Fig. 24, a horizontal 
5 conversion circuit includes a state counter 621, a 
weight generator 622, and a calculation circuit 623. 

State counter 621 is initialized at the start of a 
horizontal data, and then repeats counting according 
to a dot clock from 0 to 1 5 to output 16 states. Accord- 
to ing to the information output from state counter 621, 
weight generator 622 outputs weight to be used in the 
calculation, and indicates the dot that is not calculated 
by generating a through signal. The data valid timing 
is also generated by weight generator 622. 
15 Calculation circuit 623 sequentially calculates the 

input signal. Referring to Fig. 25, calculation circuit 
623 includes f lipflops 6231 and 6232, and a calcula- 
tion un!t 6233. AJthough the calculation results of six- 
teen dots is output for the 16 dots from the calculation 
20 circuit of Fig. 25, a data valid signal is output from 
weight generator 622 to select only 11 valid dots 
therefrom. 

The operation of the horizontal conversion circuit 
of Fig. 24 will be described with reference to Fig. 26. 

25 Although data A, B and C are expressed as repeated 
from 0 to 1 5 for the sake of convenience, it is actually 
different data from 0 to 511. When calculation is not 
carried out by a through signal and the Aside is direct- 
ly output, the conversion result is as follows. 

30 dot 0 after conversion ^ dot 0 before conver- 

sion 

dot 1 after conversion (dot 2 before conver- 
sion - dot 1 before conversion) x 5/11 + dot 1 before 
conversion 

35 dot 2 after conversion dot 3 after conversion 

dot 3 after conversion +- (dot 5 before conver- 
sion - dot 4 before conversion) x 4/11 + dot 4 before 
conversion 

dot 4 after conversion +- dot 6 before conver- 
ge sion 

dot 5 after conversion ^ (dot ,8 before conver- 
sion - dot 7 before conversion) x 3/11 + dot 7 before 
conversion 

dot 6 after conversion ^ (dot 9 before conver- 
45 sion - dot 8 before conversion) x 8/11 + dot 8 before 
conversion 

dot 7 after conversion <- (dot 11 before conver- 
sion - dot 10 before conversion) x 2/11 + dot 1 0 before 
conversion 

50 dot 8 after conversion ^ (dot 12 before con- 

version - dot 11 before conversion) x 7/11 + dot 11 be- 
fore conversion 

dot 9 after conversion dot 13 before conver- 
sion 

55 dot 1 0 after conversion <- (dot 15 before con- 

version - dot 14 before conversion) x 6/11 + dot 14 be- 
fore conversion 

Although the data itself is output discontinuously 
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when 16 dots are converted into 11 dots as described 
above, erroneous operation of the circuit of the suc- 
ceeding stage can be prevented by using a signal in- 
dicating the data valid tinning. For example, when this 
data is to be output directly to an external circuit, a 
clock for transferring only the data valid timing is out- 
put. The output is shown in Fig. 27. 

When the succeeding stage of the horizontal con- 
version circuit outputs 1 line of data discontlnuously, 
the calculation circuit shown in Fig. 25 will process un- 
necessary data to result in erroneous conversion if 
the data valid timing of the vertical side is not used. 
However, when the data valid timing of the vertical 
side is inactive, unrequired data is not sent to flipflops 
6231 and 6232 of Fig. 25 if the dot clock of the hori- 
zontal conversion circuit is suppressed. Therefore, a 
proper conversion process can be carried out. 

In the case where data transfer is not allowed by 
an unconstant timing as shown in Fig. 27, data can be 
output for every constant cycle by using the data con- 
trol circuit of Fig. 28. Referring to Fig. 28, a data con- 
trol circuit Includes a FIFO write circuit 624, a 1 line 
write detection circuit 625, a FIFO read circuit 626, 
and a FIFO 627. 

FIFO write circuit 624 generates a write signal to 
FIFO 627 using a dot clock when the validity of the 
data is specified. Although not shown, it is assumed 
that data Is directly applied to FIFO 627 from a GIF 
conversion circuit, for example, the above-described 
horizontal conversion circuit. The write signal to FIFO 
write circuit 624 is also applied to 1 line write detection 
circuit 625. 1 line write detection circuit 625 detects 
the write signal to FIFO 627, and provides a read out 
instruction to FIFO read circuit 626 when writing of 1 
line, i.e. 352 dots in the case of a GIF format, Is de- 
tected. FIFO read circuit 626 carries out a FIFO read 
out of 1 line when writing of 1 line Is detected. As a re- 
sult, data provided discontinuously can be converted 
into continuous data of 1 line. 

In the above embodiments, image format conver- 
sion can be carried out without extracting data from 
the frame memory by means of processing the image 
data sequentially and separating the vertical and hor- 
izontal conversion process. This provides the advan- 
tages that the circuit complexity is reduced and con- 
struction of an ASIC circuit can be easily carried out. 
In expanding a scanning line, not only insertion or re- 
duction of lines, but calculation of data In the line 
memory is earned out without using a frame memory, 
so that the picture quality can be improved. 

Although usage of line memories of6 lines can be 
considered in converting 6 lines into 7 lines, by pro- 
viding data of approximately 7/6 line with respect to 1 
line of the input side and providing the timing of data 
existing, a similar conversion can be carried out by 
line memories of 3 lines. Therefore, the number of 
components of the circuit can be reduced, which in 
turns lowers the cost thereof. 



In carrying out conversion in the horizontal direc- 
tion, a signal indicating the timing of valid data and a 
calculation circuit are used so that conversion can be 
achieved by just sending data sequentially to the cal- 

5 culation circuit without using a buffer or a shift regis- 
ter. Therefore, the number of components in the cir- 
cuitry can be reduced. Furthermore, by carrying out 
FIFO control on the basis of a write detection of 1 line, 
continuous data of 1 line can be output. 

10 An image processing apparatus according to a 

tenth embodiment of the present invention will be de- 
scribed. The image processing apparatus of the tenth 
embodiment can output image data of high quality 
corresponding to a square pixel. 

15 The image processing apparatus of the tenth em- 

bodiment shown in Fig. 29 differs from the image 
processing apparatus of the first embodiment shown 
in Fig. 1 in that image sensing device 1 Is modified 
Into an Image sensing device la formed of a CCD of 

20 410000 pixels, and the image conversion circuit is 
modified Into an image conversion circuit 5c for con- 
version Into a VGA format corresponding to a square 
pixel. The remaining components are similar to those 
of the Image processing apparatus of Fig. 1 . The sim- 

25 ilar components have the same reference numerals 
denoted, and their description will not be repeated. 

According to the tenth embodiment, image data 
of the image sensing device 1a is converted into a 
VGA (640x480 dots) corresponding to a square pixel 

30 by image conversion circuit 5c. It is assumed that one 
image is formed by sending 1 field {640 x 240 dots) 
of image data twice at an odd and even number field. 

In reading out the CCD of 410000 pixels for every 
odd and even number field by 768 x 247 dots, the top 

35 4 lines and the bottom 3 lines in the vertical direction 
are reduced in the present emt>odiment to result in 
240 lines. In the horizontal direction, conversion Into 
640 dots is required. The present embodiment oh- 
tains 640 dots by converting 12 dots into 10 dots. By 

40 carrying out such vertical/horizontal conversion, im- 
age data of a VGA format corresponding to a square 
pixel can be output. 

Refenring to Fig. 30, an image conversion circuit 
shown In Fig. 29 will be described. The image conver- 
ts sion circuit includes a vertical valid timing generation 
unit 63. and a 12-10 dot conversion unit 64. Vertical 
valid timing generation unit 63 Includes a first LSTN 
signal counter 631, a second LSTN signal counter 
632, and a START signal generation unit 633. 

50 Figs. 31 and 32 show signals applied to image 
conversion circuit 5c, i.e. output signals of the signal 
processing circuit. In Figs. 31 and 32, the start of a 
horizontal period and the start of a vertical period are 
shown differing In the time axis. 

55 Refenring to Fig. 31 . (a) shows a dot clock DCLK, 

(b) shows a horizontal start signal LSTN indicating the 
start of a horizontal period, (c) shows a luminance sig- 
nal, and (d) shows a color signal. Referring to Fig. 32, 
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(b) shows a vertical start signal FSTN indicating the 
start of a vertical period, and (c) shows a luminance 
signal and a color signal. 

As shown in Fig. 31, imnnediately at the end of a 
vertical blanking period, dot clock DCLK and horizon- 
tal start signal LSTN rise, whereby a valid luminance 
signal and a color signal are input. 

As shown in Fig. 32, immediately at the end of a 
vertical blanking period, horizontal start signal LSTN 
and vertical start signal FSTN rise, whereby a valid lu- 
minance signal and a color signal are input. These 
vertical and horizontal start signals FSTN and LSTN 
are formed from vertical and horizontal drive signals 
VD and HD. 

Image conversion circuit 5c of the present em- 
bodiment-includes a vertical valid timing generation 
unit 63 for providing a start signal START which be- 
comes active only during a period conresponding to 
240 valid lines in the vertical direction on the basis of 
vertical and horizontal start signals FSTN and LSTN, 
and a 12-10 dots conversion unit 64 for carrying out 
conversion of the number of dots In the horizontal di- 
rection. 

Vertical valid timing generation unit 63 Includes a 
first LSTN signal counter 631 for removing the top 4 
lines, a second LSTN signal counter 632 for counting 
240 valid lines, and a START signal generation unit 23 
for providing a start signal START that is active only 
during the period of the valid 240 lines after the top 4 
lines are removed according to the outputs of coun- 
ters 21 and 22. 

Fig. 33 is a timing chart for describing the opera- 
tion of vertical valid timing generation unit 63. In Fig. 
33, (a) shows a vertical start signal FSTN, (b) shows 
a horizontal start signal LSTN, (c) shows an output of 
a first LSTN counter 631, (d) shows an output of a 
second LSTN signal counter 632, and (e) shows a 
start signal START. 

As shown In Fig. 33, first LSTN counter 631 is 
cleared in response to the rise of horizontal start sig- 
nal LSTN when vertical start signal FSTN is active, 
and counts 4 rises of the horizontal start signal. Sec- 
ond LSTN signal counter 632 is cleared in response 
to the fall of horizontal start signal LSTN when vertical 
start signal FSTN is active. Second LSTN signal 
counter 632 counts the fall of horizontal start signal 
LSTN during the active period of start signal START. 
When the count value becomes 240, an output for ren- 
dering start signal START inactive Is provided to 
START signal generation unit 633. START signal gen- 
eration unit 633 renders start signal START active at 
the first rise of horizontal start signal LSTN after the 
count value of first LSTN signal counter 631 becomes 
4, and renders start signal START inactive when the 
count value of second LSTN signal counter 632 be- 
comes 240. 

In other words, vertical valid timing generation 
unit 63 outputs an active start signal START only dur- 



ing the period corresponding to 240 lines excluding 
the top 4 lines and the bottom 3 lines. 

As to the method of converting the number of 
dots in the horizontal direction from 12 dots to 10 

5 dots, there is a method of skipping 2 dots from 12 
dots, or obtaining the 10 dots by the calculation of 
multiplying a coefficient by each data of the 12 dots. 
12-10 dot conversion unit 64 of the present embodi- 
ment carries out this conversion by calculation. 

10 Here, Image data from video signal processing 

circuit 4 is continuously provided for 1 line in syn- 
chronization with dot clock DCLK. Therefore, when 10 
dots are to be output with respect to 1 2 dots of image 
data, a signal having a period of 10/12 the period of 

15 dot clock DCLK must be used, or, if a calculation re- 
sult is to be output in synchronization with dot clock 
DCLK, two extra dots of data must be inserted. 

In the present embodiment, the calculation result 
is output in synchronization with dot clock DCLK, and 

20 two extra dots of data are inserted. A data active sig- 
nal DTACTV indicating whether the output data is val- 
id/invalid is generated. 

Fig. 34 is a timing chart for describing the above 
operation In 12-10 dot conversion unit 24. In Fig. 34, 

25 (a) shows a dot clock DCLK, (b) shows a horizontal 
start signal LSTN, <c) shows the dot number, (d) 
shows the output data which Is the calculation result, 
and (e) shows data active signal DTACTV indicating 
the validity of the output data. Here, the number allo- 

30 cated to the output data shows the dot number used 
in the calculation. For example, 1+2 indicates that the 
image data of dot No. 1 and dot No. 2 are calculated 
and output 

In this calculation, not only simple addition, but 
35 weight is respectively applied. The present embodi- 
ment indicates the following calculation. 

dot 0 after conversion = dot 0 before conver- 
sion 

dot 1 after conversion = (dot 1 before conver- 
ge sion X 4 + dot 2 before conversion x 1)/5 

dot 2 after conversion = (dot 2 before conver- 
sion X 3 + dot 3 before conversion x 2)/5 

dot 3 after conversion = (dot 3 before conver- 
sion x 2 + dot 4 before conversion x 3)/5 
45 dot 4 after conversion = (dot 4 before conver- 

sion x 1 + dot 5 before conversion x 4)/5 

dots 5 et seq. after conversion are similar to 
dots 0 et seq. after conversion. 

This output has invalid data of 2 dots inserted 
50 with respect to the 12 dots. In the present embodi- 
ment, invalid data is inserted into the positions corre- 
sponding to dot 1 before conversion and dot 7 before 
conversion as shown In Fig. 34. 

Data active signal DTACTV Indicating valld/lnval- 
55 Id of the output data is formed by decoding the count 
value of the dot counter (not shown) counting the dot 
number provided in 12-10 dot conversion unit 64. The 
color signal has simply 1 dot skipped from 6 dots. 
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This data active signal DTACTV has the above- 
described start signal START ANDed to be output as 
the data valid timing signal of Fig. 30. Therefore, at 
the succeeding stage of image conversion circuit 5c, 
a VGA format image data corresponding to a square 
pixel of 640 dots x 240 dots can be received by fetch- 
ing converted image data only during the active per- 
iod of data valid timing signal DTACTV. 

Because image data from the CCD of image 
sensing device 1a is digitalized after A/D conversion 
to result in image data corresponding to a square pix- 
el, an image of higher quality without picture distor- 
tion can be provided in comparison with the case 
where image data is converted into an analog signal 
and then subjected to A/D conversion. Furthermore, 
the image sensing device is not limited to a CCD cor- 
responding to a square pixel. 

Because the output image data is a digital signal, 
A/D conversion is not required rn entering the same 
into a personal computer or a work station. As a result, 
the interface at the personal computer or work station 
side can be realized with a structure more simple 
than that in the case corresponding to the current 
analog inpuL 

Fig. 35 is a block diagram showing another spe- 
cific structure of an image conversion circuit of Fig. 
29. The structure up to the preceding stage of this im- 
age conversion circuit is similar to that of the embodi- 
ment of Fig. 29. 

According to a specified mode in the present em- 
bodiment, conversion is carried out into a VGA 
(640x480 dots) format (first format) conversion corre- 
sponding to a square pixel as described above, or into 
a QVGA (320x240 dots) format (second format) hav- 
ing the number of dots and the number of lines of the 
VGA format halved, or Into a Q^VGA (160x120 dots) 
format (third format) having the number of dots and 
the number of lines of the QVGA format halved. 

The image conversion circuit includes a VGA 
conversion circuit 65 for carrying out a VGA format 
conversion on the image data from video signal proc- 
essing circuit 4, and generating a data valid timing 
signal similar to the above-described structure, a 
QVGA conversion circuit 66 for converting the VGA 
format into a QVGA format, a QA/GA conversion cir- 
cuit 67 for converting the QVGA format into a Q^VGA 
format, and a valid/invalid control circuit 68 respon- 
sive to a mode specification signal that specifies a 
conversion mode via a microcomputer or an operation 
switch not shown for inhibiting or allowing the conver- 
sion operation of each of conversion means 65-67. 
The structure of VGA conversion circuit 65 is similar 
to that of the above- described embodiment, and their 
description will not be repeated. 

QVGA conversion circuit 66 converts image data 
of a VGA format from VGA conversion circuit 65 into 
image data of a QVGA format. More specifically, 
QVGA conversion circuit 66 converts the lines in the 



vertical direction to 240 lines by processing data of 
either an odd number field or an even number field, 
and converts the dots in the horizontal direction to 
320 dots by taking the average value of two adjacent 

5 dots. Identification of a field is carried out using a 
field identification pulse that is output from a general 
timing IC that is used in drive circuit 7 of Fig. 29. 

When image data in the horizontal direction is in- 
put and output in synchronization with dot dock DCLK 

10 as in the above-described embodiment, it is neces- 
sary to insert valid data of 1 dot with respect to 2 dots. 
In the present embodiment, a first data active signal 
DTACTV1 indicating the timing of a valid data is gen- 
erated. 

15 Fig. 36 is a timing chartfor describing the conver- 

sion operation of QVGA conversion circuit 66. In Fig. 
36, (a) shows a dot clock DCLK, (b) shows a horizon- 
tal start signal LSTN, (c) shows a VGA output data 
from VGA conversion circuit 66, (d) shows a data ac- 

20 tive signal DTACTV indicating whether VGA output 
data Is valid/invalid, (e) shows a dock signal VCL 
which is an ANDed output of dot clock DCLK and data 
active signal DTACTV delayed by 1 dot clock, (f) is the 
calculated result of the average value of two adjacent 

25 dots, and (g) shows a first data active signal 
DTACTV1 indicating whether output data is valid/in- 
valid. First data active signal DTACTV1 is a signal that 
has the level inverted in response to a rise of clock 
signal VCLK. 

30 The calculation of the horizontal direction in 

QVGA conversion circuit 66 uses a calculation unit 
that outputs the average values of data adjacent to 
each other. Also, dot dock DCLK is used as clock and 
data active signal DTACTV is used as a clock enable, 

35 whereby only valid data of the VGA conversion is in- 
put to the calculation unit. 

Clock signal VCLK which Is an ANDed output of 
dot clock DCLK and data active signal DTACTV which 
is 1 dot clock delayed may be used as the dock in- 

40 stead of the clock enable. In this case, the structure 
of the circuitry indudes two stages of flipflops 661 
and 662, and a calculation unit 663, as shown in Fig. 
37. 

A data valid timing signal indicating the validity of 
45 QVGA output data of QVGA conversion circuit 66 is 
the ANDed output of first data active signal DTACTV1 
and the above-described field identification pulse. 
This data valid timing signal is applied to Q^VGA con- 
version drcuit 67 together with a QVGA output 
50 The QVGA format image data from QVGA con- 
version circuit 66 will be described on the basis of 
Q2VGA conversion circuit 67 that carries out a Q^VGA 
format image data conversion. Q^VGA conversion cir- 
cuit 67 converts the image data of a QVGA format to 
55 1/2 in both the vertical and horizontal direction. 

As to the vertical direction, a method of calculat- 
ing the average value of the data of 2 lines to obtain 
1 line, and a method of simply skipping 1 line can be 
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considered. In the present embodiment, the average 
value of two lines of data is calculated to be merged 
into 1 line. 1 line of valid data is obtained for every 2 
lines, and a line active signal LNAV indicating whether 
the line is valid/invalid Is generated. 5 

As to the horizontal direction, similar to the con- 
version by QVGA conversion circuit 66, conversion is 
carried out by taking the average value of two adja- 
cent dots, and a second data active signal DTACTV2 
indicating whether the converted data is valid/invalid io 
is generated. 

Referring to Fig. 38, Q^VGA conversion circuit 67 
includes a line memory control circuit 671, a line 
memory 672, a vertical 1/2 calculation unit 673, a hor- 
izontal 1/2 calculation unit 674, a line valid/invalid in- 15 
dication signal generation unit 675, a dot valid/invalid 
indication signal generation unit 676. 

Line memory control circuit 671 writes the QVGA 
output data into line memory 672, and carries out con- 
trol so that data of the preceding tine Is read out. Then, 20 
vertical 1/2 calculation unit 673 calculates the aver- 
age value of QVGA output data of 1 preceding line and 
the current QVGA output data. This data is applied to 
horizontal 1/2 calculation unit 674 in which calculation 
of an average value with an adjacent dot is carried 25 
out. 

Line valid/invalid instruction signal generation 
unit 675 generates a line active signal LNAV which be- 
comes active for every other 1 line as shown in Fig. 
39(d) in response to start signal START shown in Fig. 30 
39(c) and horizontal start signal LSTN shown In Fig. 
39(b). 

Dot valid/invalid instruction signal generation unit 
676 generates a second data active signal DTACTV2 
which becomes active for every other first data active 35 
signal DTACTV1 In response tof irstdata active signal 
DTACTV1 shown in Fig. 40(e) and dot dock signal 
DCLK shown in Fig. 40(a). 

The calculation result shown In Fig. 40(f) using 
clock signal VCLK shown in Fig. 40(c) as a clock 40 
which was used for QVGA conversion cannot be ob- 
tained by just averaging the Input adjacent data in hor- 
izontal 1/2 calculation unit 674. Calculation between 
data spaced apart by 1 dot must be carried out 

Therefore, horizontal 1/2 calculation unit 674 of 45 
the present embodiment Includes three stagesof flip- 
flops 664-666, whereby calculation of the output of 
the first stage f lipf lop 664 and the output of the third 
stage fllpflop 666 are carried out by calculation unit 
667. 50 

The data valid timing signal indicating whether 
Q2VGA output data of Q^VGA conversion circuit 67 is 
valid/invalid is the ANDed output of first data active 
signal DTACTV1, the above-mentioned field identifi- 
cation pulse, tine active signal LNAV, and second data 55 
active signal DTACTV2. This data valid timing signal 
is provided together with the Q^VGA output 

Valid/invalid control circuit 68 shown In Fig. 35 re- 



sponds to a specified mode and allows only the con- 
version operation of VGA conversion circuit 65 and in- 
hibits the conversion operations of QVGA conversion 
circuit 66 and Q^VGA conversion circuit 67 when a 
VGA mode is specified. Also, VGA output data from 
VGA conversion circuit 65 and a data valid timing sig- 
nal are passed through. When a QVGA mode is spe- 
cified, the conversion operation by VGA conversion 
circuit 65 and QVGA conversion circuit 66 are al- 
lowed, and the conversion operation of Q^VGA con- 
version circuit 67 is inhibited. Also, QVGA output data 
from QVGA conversion circuit 66 and a data valid tim- 
ing signal are passed through. When a Q^VGA mode 
is specified, the conversion operation of all conver- 
sion circuits 65-67 are allowed. 

By providing a QVGA conversion circuit 66 and a 
Q2VGA conversion circuit 67 at the succeeding stage 
of VGA conversion circuit 65, conversion of a plurality 
of formats can be carried out with a relatively simple 
circuit structure in comparison with the case where 
each conversion Is carried out individually. 

Furthermore, because image data can be provid- 
ed to each of conversion units 65-67 with a common 
dot clock DCLK, conversion of the transfer rate of the 
Image data is not required. It is also suitable to a 
FPGA (Field Programmable Gate Array) In which the 
number of dock lines are limited. 

Another specific structure of the Q^VGA conver- 
sion circuit of Fig. 35 will be described. Components 
corresponding to those of Fig. 38 have the same ref- 
erence characters denoted, and their description will 
not be repeated. 

The Q2VGA conversion circuit of Fig. 42 indudes 
a horizontal 1/2 calculation unit 677 at a preceding 
stage of line memory 679. Second data active signal 
DTACTV2 Is input to line memory control circuit 678, 
whereby the line memory clock of line memory 678 is 
merged with second data active signal DTACTV2 In- 
dicating the validity of horizontal .1/2 conversion data. 

The operation of the Q^VGA conversion circuit of 
Fig. 42 will be described hereinafter with reference to 
Fig. 43. Line memory 679 has the reading and writing 
pointer reset by the reset pulse shown In Fig. 43(a). 
Reading and writing of position data Is carried out by 
the line memory clock shown in Fig. 43(h), whereby 
reading and writing is canried out with respect to the 
same address at the same time. 

Because the Q^VGA conversion circuit of Fig. 42 
writes only the data after horizontal conversion, the 
capacity of the line memory can be reduced in com- 
parison with that of the Q^VGA conversion circuit of 
Fig. 38. The remaining structure Is similar to that of 
the above-described embodiment. 

Another specific example of an image conver- 
sion circuit shown in Fig. 29 will be described herein- 
after with reference to Fig. 44. Components in the lnr>- 
age conversion circuit of Fig. 44 corresponding to 
those of Fig. 35 have the same reference characters 
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denoted, and their description will not be repeated. 

The image conversion circuit of Fig. 44 includes 
an edge enhancement circuit 69 at the succeeding 
stage of Q2VGA conversion circuits?. By valid/invalid 
control circuit 68a, the enhancennent operation of 5 
edge enhancement circuit 69 is inhibited or allowed. 

Edge enhancement circuit 69 is formed of a con- 
ventionally well known filter for edge enhancement to 
enhance the edge of an image having its contour blur- 
red according to the calculation by each of conversion io 
circuits 65-67. The remaining structure is similar to 
that of the above-described embodiment. 

Application of the present invention to another 
conversion format will be described hereinafter. For 
example, the present invention is applicable, in addi- 15 
tion to the above-described CCD of 41 0000 pixels, to 
a CCD of 220000 (362x582 pixels). It is also applica- 
ble to the case of a multi-stage conversion where the 
first stage of conversion is to a GIF format (352x288 
dots), and the second stage of conversion is to a 20 
QCIF (176x144 dots) format 

For example, using a first conversion circuit cor- 
responding to VGA conversion circuit 65 of the above- 
described embodiment, the number of dots is re- 
duced by removing the Ieft4 dots and the right 6 dots, 25 
and the number of lines is reduced by removing the 
top 3 lines of one field to obtain image data corre- 
sponding to a GIF format. This GIF format image data 
is passed through QVGA conversion circuit 66, and 
then subjected to a process described above by 30 
QA/GA 67, resulting in a conversion into image data 
of QCIF format. 

In this case, the average value calculation in the 
horizontal direction in Q^VGA conversion circuit 67 is 
carried out between adjacent dots, and not between 35 
dots spaced apart by 1 dot as in the above-described 
embodiment. Therefore, the horizontal 1/2 calculation 
unit of Fig. 41 can be used. As shown in Fig. 45, a se- 
lector 668 for selecting either output of flipf lop 664 of 
the first stage or flipf lop 665 of the second stage may 40 
be provided to select a QA/GA format conversion or 
a QCIF format conversion. The present invention is 
also applicable to a CCD of 270000 pixels (512x492 
pixels) wherein a QVGA format conversion is carried 
out at the first stage, and a Q^VGA format conversion 45 
is carried out at the second stage. 

In this case, a first conversion circuit correspond- 
ing to the above-described VGA conversion circuit 65 
reduces the number of 16 dots to 10 dots, and reduc- 
es the number of lines of one field by removing the top so 
and bottom 3 lines to obtain image data of a QVGA 
format. This image data is passed through the above- 
described QVGA conversion circuit 66, and subjected 
to a process by a QA/GA conversion circuit that In- 
cludes a horizontal 1/2 calculation unit shown in Fig. 55 
45. Thus, a QA/GA format conversion is carried out. 

As described above, the conversion of two sta- 
ges effectively uses the Q^VGA conversion circuit in- 



cluding a horizontal 1/2 calculation unit shown in Fig. 
45. Therefore, when an ASIC circuit is formed with 3 
conversion circuits 65-67 as one circuit, it is neces- 
sary to design the circuit individually according to its 
usage for the first stage conversion. However, the 
conversion of the second stage can be carried out us- 
ing Q^GA conversion circuit 67, so that the versatil- 
ity of ASIC is improved, and the efficiency increased. 
The present invention is not limited to the above- 
described emtxjdiment where three conversion cir- 
cuits are provided, and two or four or more conversion 
circuits may be provided. 

An image processing apparatus according to an 
eleventh embodiment of the present invention will be 
described with reference to Fig. 46 showing a block 
diagram of a structure thereof. 

Referring to Fig. 46, an image processing appa- 
ratus includes a camera head unit CH, and a digital 
signal processing unit DS. Camera head unit CH in- 
cludes an image sensing device 1, a pre-processing 
circuit 2, an A/D conversion circuit 3, a drive circuit 7, 
and a head unit control circuit 11. Digital signal proc- 
essing unit DS includes a video signal processing cir- 
cuit 4, an image conversion circuit 12, an image de- 
tection circuit 9 , and an image conversion control cir- 
cuit 13. The components of the image processing ap- 
paratus of Fig. 46 corresponding to those of the im- 
age processing device of the above-descrifc>ed em- 
bodiments have the same reference characters de- 
noted, and their description will not be repeated. 

Head unit control circuit 11 controls A/D conver- 
sion circuit 3 and drive circuit 7 to control the opera- 
tion of camera head unit CH. Image conversion circuit 
12 converts the image data to an image size speci- 
fied by image conversion control circuit 13, for exanv 
pie converts the data into image data FD of a CIF or 
a VGA format according to luminance signal Y and 
color signals R-Y and B-Y provided from video signal 
processing circuit 4. Image conversion circuit 12 is 
formed of a FPGA (Field Programmable Gate Array) 
to have an arbitrary logic programmed according to 
program data. Image conversion control circuit 13 
programs a predetermined logic that realizes the spe- 
cif ied optimum image conversion nnethod into an in- 
ternal logic circuit of image conversion circuit 12. 

The control operation of Image conversion con- 
trol circuit 13 of Fig. 46 wilt be described hereinafter 
with reference to the flow chart of Fig. 47. 

Referring to Fig 47, at step 81, the determination 
result of image detection circuit 9 is applied to image 
conversion control circuit 13. At step S2, confirmation 
is made whether the determination result indicates a 
moving picture. If a moving picture is indicated, the 
program proceeds to step 87, in which a predeter- 
mined logic is programmed In the FPGA internal logic 
circuit to set the image conversion method of the im- 
age conversion circuit to that corresponding to a mov- 
ing picture. When the image is not a moving picture, 
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the control proceeds to step S3 where confirmation is 
made whether the image Is a person in a still picture. 
If yes. the control proceeds to step S8 where the logic 
circuit in FPGA Is programmed to a predetermined 
logic to set the Image conversion method to that cor- 5 
responding to a person. 

If determination is made that the image is not a 
still picture, It is assumed that the Image Is a still pic- 
ture and a text image. The control proceeds to step 
S4 where the logic circuit In FPGA is programmed to io 
a predetenmined logic to set the image conversion 
method of image conversion circuit 12 to that for text. 
Here, Image conversion circuit 12 Is formed of a pro- 
grammable logic circuit of a FPGA or the like. A logic 
circuit in FPGA can easily by set by rewriting the con- is 
tents of the memory such as an EEPROM (Electric 
Erasable Programmable Read Only Memory) or the 
like connected to the FPGA, or by specifying the ad- 
dress of the memory. 

When each process of steps S4, S7 and S8 Is 20 
completed, the control proceeds to step S5. Image 
conversion circuit 12 converts a digital video signal 
that is input according to a predetermined image con- 
version method Into image data FD corresponding to 
a predetermined Image format according to the set 25 
logic. Then, image data FD is output. At step S6, con- 
firmation is made whether data ends or not. When the 
data ends, the process is terminated. If the data has 
not yet ended, the control moves to step S1 to con- 
tinue the subsequent process. More specifically, in 30 
the case of a subsequent data, the logic circuit In Im- 
age conversion circuit 12 is set according to the de- 
termination result of inf^ge detection circuit 9 again, 
and an image format conversion corresponding to the 
feature of the Image is executed according to the set 35 
predetermined logic. Then, Image data FD of a prede- 
termined Image format Is output. 

A specific example of Image conversion circuit 12 
set in the above process will be described hereinafter. 
Fig. 48 is a block diagram showing a first specific 40 
structure of the image conversion circuit of Fig. 46. 
The first specific example shows the case where im- 
age conversion control circuit 24 sets image conver- 
sion circuit 12 as an Image conversion circuit 12a that 
carries out an image conversion for text according to 45 
the above-described (low chart 

Referring to Fig. 48. Image conversion circuit 12a 
Includes an interface (l/F) 120, and a VGA conversion 
circuit 121. VGA conversion circuit 121 reduces the 
number of dots in the horizontal direction and the 50 
number of lines In the vertical direction of the Input 
digital video signal DP. More specifically, the top 4 
lines and the bottom 3 lines of each odd number and 
even number field are removed, and the data of 6 dots 
is reduced to 5 dots, resulting In an output of Image 55 
data VGA corresponding to a VGA format The logic 
circuit of the FPGA Is programmed according to pro- 
gram data PDa output from Image conversion control 



circuit 13 via interface 120 to fonm VGA conversion 
circuit 121. 

A second specific example of the image conver- 
sion circuit of Fig. 46 will be described hereinafter 
with reference to Fig. 49 showing a block diagram of 
a structure thereof. In the second specific example, 
image conversion control circuit 24 sets image con- 
version circuit 12 as an image conversion circuit 12b 
that carries out an image conversion for a person ac- 
cording to the above-described flow chart 

Referring to Fig. 49, image conversion circuit 12b 
includes an interface 120, a VGA conversion circuit 

121, and a horizontal 1/2 conversion circuit 122. The 
logic circuit In the FPGA Is programmed to a logic that 
carries out a person image conversion In response to 
program data PDboutputf rom image conversion con- 
trol circuit 13 via interface 120 to form VGA conver- 
sion circuit 121 and horizontal 1/2 conversion circuit 

122. VGA conversion circuit 121 converts digital vid- 
eo signal DP to image data corresponding to a VGA 
format similar to VGA conversion circuit 121 shown in 
Fig. 48, and provides the same to horizontal 1/2 con- 
version circuit 122. Horizontal 1/2 conversion circuit 
122 reduces the number of dots of the input Image 
data to 1/2 in the horizontal direction, and outputs im- 
age data QVGA corresponding to a QVGA format. 

A third specific example of the image conversion 
circuit of Fig. 46 will be described hereinafter with ref- 
erence to Fig. 50 which is a block diagram showing a 
structure thereof. In the third specific example, im- 
age conversion control circuit 24 sets Image conver- 
sion circuit 12 as an image conversion circuit 12c that 
carries out an image conversion for a moving picture 
according to the above-described flow chart. 

Referring to Fig. 50, Image conversion circuit 12c 
includes an Interface 120, a VGA conversion circuit 
121, a horizontal 1/2 conversion circuit 122, and a 
vertical horizontal 1/2 conversion circuit 123. Accord- 
ing to program data PDc output from image conver- 
sion control circuit 13 via interface 120, the logic cir- 
cuit In the FPGA Is programmed to a fM'edetermined 
logic that carries out Image conversion for a moving 
image to form VGA conversion circuit 1 21 , horizontal 
1/2 conversion circuit 122, and vertical horizontal 1/2 
conversion circuit 123. Similar to the image conver- 
sion circuit of Fig. 49, VGA conversion circuit 121 and 
horizontal 1/2 conversion circuit 122 provides image 
data corresponding to a QVGA format to 
vertical horizontal 1/2 conversion circuit 123. 
Vertical-horizontal 1/2 conversion circuit 123 reduces 
the Input image data to 1/2 the number of lines In the 
vertical direction, and 1/2 the number of dots in the 
horizontal direction, and outputs Image data 1/16 
VGA corresponding to a 1 /1 6VGA format 

By programming an image conversion circuit 12 
formed of one FPGA according to a predetermined 
logic in the prevent eleventh embodiment, image data 
conresponding to an image format conversion method 
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conforming to the feature of the image can be output. 
An arbitrary Image format conversion process can be 
carried out without Increasing circuit complexity. It is 
not necessary to additionally provide a circuit corre- 
sponding to each conversion method in carrying out 5 
an image format conversion of another format, for ex- 
ample a GIF format, a SIF format, or the like. By pro- 
viding a FPGA circuit having the minimum number of 
required components for conversion in advance, an 
image conversion circuit corresponding to any con- io 
version format can be formed. Therefore, increase in 
circuit complexity can be suppressed. 

An image processing apparatus according to a 
twelfth embodiment of the present invention will be 
described hereinafter with reference to the block dia- is 
gram of Fig. 51 showing a structure thereof. The inv 
age processing circuit of Fig. 51 differs from the im- 
age processing apparatus of Fig. 46 in that the digital 
signal processing unit is modified to a digital signal 
processing unit DSa that operates upon receiving a 20 
control signal from an external control device 16. The 
remaining components are similar to those shown In 
Fig. 46, with the conresponding components having 
the same reference characters denoted. Their de- 
scription will not be repeated, 25 

Referring to Fig. 51, digital signal processing unit 
DSa includes an image conversion circuit 12, a digital 
signal processing circuit 14, and a signal processing 
unit control circuit 15. Digital signal processing circuit 
14 and image conversion circuit 12 are formed of a 30 
FPGA that can have an arbitrary logic programmed. 
Signal processing unit control circuit 15 receives a 
control signal concerning the specification of the re- 
solution of image sensing device 1 and the conver- 
sion method of image conversion circuit 12. On the 35 
basis of the input control signal, signal processing unit 
control circuit 15 provides program data PD1 to digital 
signal processing circuit 14, and program data PD2to 
image conversion circuit 12. Digital signal processing 
circuit 14 has the internal logic circuit programmed ac- 40 
cording to program data PD1 to form a digital signal 
processing circuit 14 that carries out a predetermined 
video signal process. Image conversion circuit 12 has 
the internal logic circuit programmed according to 
program data PD2 to form an image conversion circuit 45 
that carries out a predetermined image format con- 
version process. Digital signal processing circuit 14 
receives a digital image signal Dl from camera head 
unit CH to carry out a predetermined video signal 
process, and then outputs digital video signal DP. Im- so 
age conversion circuit 12 carries out a predetermined 
image format conversion on input digital video signal 
DP, and provides image data FD corresponding to a 
predetermined image format 

The control operation of the signal processing 55 
unit control circuit of Fig. 51 will be described herein- 
after with reference to the flow chart of Fig. 52. 

Refenring to Fig. 52, at step S11, a control signal 



specifying the resolution of image sensing device 11 
and the conversion method of Image conversion cir- 
cuit 12 is input from an external control device such 
as a microcomputer. At step S12, determination is 
made whether the Input control signal specifies the 
resolution of image sensing device 1 or specifies a 
conversion method. When a conversion method is 
specified, the control proceeds to step SI 3. 

When a resolution Is specified, control of digital 
signal processing circuit 14 is initiated at step S22. At 
step S23, determination is made whether the resolu- 
tion of image sensing device 1 Is 190000 pixels. If 
YES, the process proceeds to step S20, otherwise to 
step S24. At step S20, the internal logic circuit of dig- 
ital signal processing circuit 14 is specified according 
to the video signal processing method of 190000 pix- 
els. When the resolution is not 190000 pixels, deter- 
mination is made whether the resolution is 270000 
pixels at step 824. If YES, the process proceeds to 
step S21 to set the internal logic circuit of digital signal 
processing circuit 14 according to the video signal 
processing method for 270000 pixels. If the resolution 
is not 270000 pixels, determination is made that the 
resolution is 410000 pixels. At step S25, the internal 
logic circuit of digital signal processing circuit 14 is 
specified according to the video signal processing 
method for 410000 pixels. Thus, a digital signal proc- 
essing circuit 14 that realizes a video signal process 
according to the resolution of image sensing device 
1 can be constructed. At step S26, input digital video 
signal Dl is processed according to the set video sig- 
nal process, and digital video signal DP is output At 
step S27, determination is made whether data input 
has ended or not If YES, the process is terminated. 
If NO, the process returns to step S1 1 to carry out the 
subsequent process. 

When determination is made that a conversion 
method is specified at step S12, control of the image 
conversion circuit is Initiated at step SI 3. At step S14, 
determination is made whether the conversion Is for 
a moving picture. If YES, a logic circuit corresponding 
to a moving image conversion method is set In digital 
signal processing circuit 14 at step SIS. If the image 
Is not a moving picture, the process proceeds to step 
SI 5 where determination is made whether the con- 
version is for a person in a still picture. If YES, the 
process proceeds to step 519 where a logic circuit 
con-esponding to a person oriented image conversion 
method is specified in image conversion circuit 12. If 
the conversion is not for a person In a still picture, de- 
termination is made that It Is a conversion method for 
text at step S16 to set a logic circuit corresponding to 
a text oriented image conversion method in image 
conversion circuit 1 2. Thus, a logic circuit correspond- 
ing to a specified conversion method Is set in image 
conversion circuit 12. Then, at step SI 7, image format 
conversion is carried out using the specified image 
conversion circuit 12, and image data FD correspond- 
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ing to a predetermined image format is output. At step 
S27, determination is made whether the data has 
ended or not. If NO, the process proceeds to step S11 . 
If YES, the process is terminated. 

A specific example of a digital signal processing 5 
circuit specified according to the flow chart of Fig. 52 
will be described hereinafter with reference to the 
block diagram of Fig. 53 showing a first specific struc- 
ture thereof. A digital signal process is carried out us- 
ing a CCD of 190000 pixels. 270000 pixels, or 410000 io 
pixels as image sensing device 1 of Fig. 51 for output 
to an image conversion circuit. Here, a digital video 
signal circuit includes peripheral circuits of the so-cal- 
led image signal processing circuit and a timing gen- 
eration circuit for video signal processing. 15 

In the first specific example, signal processing 
unit control circuit 15 specif ies digital signal process- 
ing circuit 14 as a digital signal processing circuit 14a 
that carries out a digital video signal process of 
1 90000 pixels. 20 

Referring to Fig. 53, digital signal processing cir- 
cuit 14a includes an Interface 140, a RBYl separation 
circuit 141, a RBY^ color processing circuit 142, a lu- 
minance signal processing circuit 143, and a 190000- 
pixel timing generation circuit 144. According to pro- 25 
gram data PDla output from signal processing unit 
control circuit 15 via interface 140, the internal logic 
circuit of the FPGA is programmed to a predetermined 
logic to form RBYl separation circuit 141, RBYl color 
processing circuit 142, luminance signal processing 30 
circuit 143, and 190000-pixel timing generation circuit 
144. 

Digital image data Dl output from AID conversion 
circuit 3 Is applied to RBYl separation circuit 141 to 
have color difference signals R-Y and B-Y separated 35 
and output to RBYl color processing circuit 142. RBYl 
color processing circuit 142 adjusts the gain and 
phase of the input color difference signals R-Y and B- 
Y. Luminance signal processing circuit 143 receives 
digital Image signal Dl to adjust the gain and clip level 40 
of luminance signal Y. 190000-pixel timing generation 
circuit 144 provides a predetermined timing signal 
corresponding to the video signal processing method 
for 190000 pixels to RBYl separation circuit 141, 
RBYl color processing circuit 142, and luminance sig- 45 
nal processing circuit 143, whereby RBYl separation 
circuit 141, RBYl color processing circuit 142 and lu- 
minance signal processing circuit 143 carry out the 
above-described operation in response to an input 
timing signal. Thus, luminance signal Y and color dif- so 
ference signals R-Y and B-Y subjected to a video sig- 
nal process of 190000 pixels are output as digital vid- 
eo signal DP. 

A second specific example of the digital signal 
processing circuit of Fig. 51 will be described herein- 55 
after with reference to the block diagram of Fig. 54 
showing a structure thereof. Here, signal processing 
unit control circuit 15 specifies digital signal process- 



ing circuit 14 as a digital signal processing circuit 14b 
that carries out a digital signal video process for 
270000 pixels according to the flow chart of Fig. 52. 

Digital signal processing circuit 14b of Fig. 54 dif- 
fers from digital signal processing circuit 14a of Fig. 
53 in that a 270000-pixel timing generation circuit 145 
is formed instead of 190000-pixel timing generation 
circuit 144. The remaining components are similar to 
those of the above described digital signal processing 
circuit 14a, and their description will not be repeated. 
According to program data PDlb from signal process- 
ing unit control circuit 15 via interface 140, the inter- 
nal logic circuit of the FPGA is progranmied to a pre- 
determined logic to form a RBYl separation circuit 

141, a RBYl color processing circuit 142, a luminance 
signal processing circuit 143 and a 27 0000- pixel tim- 
ing generation circuit 145. 270000-pixel timing gener- 
ation circuit 145 provides a timing signal suitable for 
the video signal process for 270000 pixels to RBYl 
separation circuit 141, RBYl color processing circuit 

142, and luminance signal processing circuit 143, so 
that they operate in a manner similar to the operation 
of the digital signal processing circuit of Fig. 53 in re- 
sponse to an input timing signal. As a result, digital 
signal processing 14b provides digital video signal DP 
subjected to a video signal process for 270000 pixels. 

A third specific example of the digital signal proc- 
essing circuit of Fig. 51 will be described hereinafter 
with reference to the block diagram of Fig. 55 showing 
a structure thereof. In the third specific example, sig- 
nal processing unit control circuit 15 sets digital signal 
processing circuit 14 as a digital signal processing cir- 
cuit 14c that carries out a digital signal process for 
410000 pixels. 

Digital signal processing circuit 14c of Fig. 55 dif- 
fers from digital signal processing circuit 14a of Fig. 
53 in that a 41 0000-pixel timing generation circuit 1 46 
is fbnned instead of 190000-pixe! timing generation 
circuit 144. The remaining components are similar to 
those of the above-described digital signal process- 
ing circuit 14a, and their description will not be repeat- 
ed. 

According to program data PDIc output from sig- 
nal processing unit control circuit 15 via Interface 140, 
the internal logic circuit of the FPGA is programmed 
to a predetermined logic to form a RBYl separation 
circuit 141, a RBYl color processing circuit 142, a lu- 
minance signal processing circuit 143, and a 410000- 
pixel timing generation circuit 146. 410000-pixel tinv 
ing generation circuit 146 provides a timing signal 
suitable for a video signal process of 410000 pixels to 
RBYl separation circuit 251, RBYl color separation 
circuit 142, and luminance signal processing circuit 

1 43, so that these circuits operate in a manner similar 
to the operation of the digital signal processing circuit 
shown in Fig. 53. As a result, digital signal processing 
circuit 14c provides a digital video signal DP subject- 
ed to a video signal process for 410000 pixels. 
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Because digital signal processing circuit 14 is 
formed of a FPGA, an arbitrary video signal process 
can be realized by setting a predetermined logic pro- 
gram by a predetermined logic data. An arbitrary vid- 
eo signal process can be canried out by one FPGA. 5 
Therefore, the circuit complexity is not increased, and 
an arbitrary video signal process can be carried out. 

Image conversion circuit 12 of Fig. 51 is formed 
of a FPGA as in the image conversion circuit of Fig. 
46 to realize an arbitrary image format conversion io 
process according to program data output from signal 
processing unit control circuit 15. Therefore, digital 
signal processing circuit 14 and image conversion cir- 
cuit 12 can realize an arbitrary video signal process 
and image format conversion process according to 15 
the resolution of image sensing device 1 or the spe- 
cified conversion method. Even if a line sensor used 
in a scanner is employed as image sensing device 1, 
a circuit does not have to be nev^ly provided. A video 
signal process and an image fonmat conversion proc- 20 
ess according to the resolution of the line sensor can 
be carried out. 

An image processing apparatus according to a 
thirteenth emtwdimentof the present invention will be 
described hereinafter with reference to the block dia- 25 
gram of Fig. 56 showing a structure thereof. 

Referring to Fig. 56, the present image process- 
ing apparatus includes a still picture camera head 
unit CHa, a moving picture camera head unit CHb, 
and a digital signal processing unit DSb. Still picture 30 
camera head unit CHa includes an image sensing de- 
vice la, a pre-processing circuit 2a, an A/D conver- 
sion circuit 3a, a drive circuit 7a, and a head unit con- 
trol circuit 11a. Move picture camera head unit CHb 
includes an image sensing device lb, a pre-process- 35 
ing circuit 2b, an A/D conversion circuit 3b, a drive cir- 
cuit 7b, and a head unit control circuit 11b. Digital sig- 
nal processing unit DSb includes a signal switching 
circuit 18, a digital signal processing circuit 14, an im- 
age conversion circuit 12, a signal processing unit 40 
control circuit 17, a control circuit 19, and an image 
memory 20. 

A CCD of 190000 pixels is used as image sensing 
device 1a. and a CCD of 410000 pixels is used as inv 
age sensing device 1 b. Alternatively, a line sensor or 45 
the 11 ke used in a scanner may be employed as image 
sensing device 1a. Still picture and moving picture 
camera head units CHa and CHb operate in a manner 
similar to that of camera head unit CM of Fig. 46, and 
output a digital image signal SDI of a still picture and so 
digital image signal MDI of a moving picture respec- 
tively. 

According to the control of control circuit 19, sig- 
nal switching circuit 18 selects either the input digital 
image signal SDI or MDI to provide the same to digital . 55 
signal processing circuit 14. Digital signal processing 
circuit 14 and image conversion circuit 12 are formed 
of a FPGA similar to that of the second embodiment, 



and have an arbitrary logic programmed according to 
program data PD1 or PD2 output from signal process- 
ing unit control circuit 17. According to the program- 
med logic, digital signal processing circuit 14 gener- 
ates a digital video signal DP of luminance signal Y 
and color signal R-Y and B-Y, and carries out a white 
balance process, a gamma correction process, or the 
like. Image conversion circuit 12 converts the image 
data into an image size specified by signal process- 
ing unit control circuit 17, for example a GIF, a VGA, 
or the like format according to the input luminance 
signal Y and color signals R-Y and B-Y. According to 
the control of control circuit 19, image memory 20 
stores digital data of a still picture subjected to an lnr>- 
age conversion process by image conversion circuit 
1 2. According to the resolution and image format con- 
version method specified by control circuit 19, signal 
processing unit control circuil U programs digital sig- 
nal processing circuit 14 and image conversion circuit 
12 to a predetermined logic. Control circuit 19 is 
formed of a microcomputer or the like to control signal 
processing unit control circuit 17, signal switching cir- 
cuit 18, and image memory 20 as set forth In the fol- 
lowing. When digital image signal MDI for a moving 
picture attains a blanking period, signal switching cir- 
cuit 18 provides digital video signal SDI of a still pic- 
ture to digital signal processing circuit 14. Digital sig- 
nal processing circuit 14 and image conversion circuit 
12 execute an image signal process and a part of an 
image format conversion process suitable for the re- 
solution of image sensing device la and the process 
for a still image, whereby the generated image data 
is sequentially stored in image memory 20. When all 
the input image data are stored and the process is 
completed, image memory 20 outputs still image 
data SFD. When digital image signal MDI of a moving 
picture does not attain a blanking period, signal 
switching circuit 18 provides digital video signal MDI 
of a nrwving picture to digital signal processing circuit 
14. Digital signal processing circuit 14 and image con- 
version circuit 12 execute a video signal process and 
an image format conversion process that matches the 
resolution of the image sensing device lb and the 
moving picture to output moving data MFD. 

The control operation of the control circuit of Fig. 
56 will be described hereinafter with reference to the 
flow chart of Fig. 57. 

Referring to Fig. 57, at step 831, determination is 
made whether digital image signal MDI of a moving 
picture provided from moving picture head camera 
unit 1 b which is a camera for a moving picture attains 
a blanking period or not If YES, the process proceeds 
to step S37, otherwise to step S32. If not at a blanking 
period, a conversion method for a moving picture is 
specified in signal processing unit control circuit 17 at 
step S32. At step 333, the resolution of 190000 pixels 
is specified in signal processing unit control circuit 1 7. 
At step S35, signal processing unit control circuit 15 
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carries out specification so that digital signal process- 
ing circuit 14 and image conversion circuit 12 canry 
out a video signal process and an image format con- 
version process for a moving picture. At step S36, a 
process for a moving picture is carried out using the 5 
specified digital signal processing circuit 14 and im- 
age conversion circuit 12 to output Image data MFD 
of a moving picture. Then, the process returns to step 
S31 to carry out the subsequent process. 

When digital image signal MDI of a moving pic- io 
ture attains a blanking period, determination is made 
whether digital video signal SDI of a still picture is out- 
put or not at step S37. If NO, the process proceeds to 
step S32 to carry out the subsequent process. If dig- 
ital Image signal SDt Is output, the process proceeds is 
to step S38. When digital image signal SDI of a still 
picture is input, a conversion method for a still picture 
is specified in signal processing unit control circuit 17 
at step S38. At step S39, the resolution Is set to 
410000 pixels in signal processing unit control circuit 20 
17. At step S40, signal processing unit control circuit 
17 programs digital signal processing circuit 14 and 
image conversion circuit 12 to achieve a logic corre- 
sponding to an Image signal process and an Image 
format conversion process for a still picture. Digital 25 
signal processing circuit 14 and image conversion cir- 
cuit 12 execute a still image video signal process and 
a part of the image format conversion process ac- 
cording to the specified logic, and provides the con- 
verted image data to image memory 20. 30 

At step S41, image memory 20 stores the con- 
verted result. At step S42, determination is made 
whether the data stored in image memory 20 forms 
one still picture video or not. When one still picture is 
not yet formed, the process returns to step S31 to car- 35 
ry out the subsequent process. If 1 still picture is 
formed, the process proceeds to step 543 where the 
one still picture stored in video memory 20 is output 
as image data SFD. 

According to the above operation, digital image 40 
signal SDI of a still picture Is processed during the 
blanking period, I.e. when digital Innage signal MD of 
a moving picture does not have to be processed by 
digital signal processing circuit 14 and image conver- 
sion circuit 12. Therefore, the process for a moving 45 
picture and a still picture can be effectively canried 
out. Because the above-described process Is carried 
out by digital signal processing circuit 14 and Image 
conversion circuit 12 formed by a FPGA, circuit com- 
plexity is not increased. In the thirteenth embodiment, so 
a video signal process and an image format conver- 
sion process according to the resolution of the Image 
sensing device and the feature of the Image can be 
carried out. An optimum image signal process and im- 
age format conversion process can be realized with- 55 
out increasing the circuit complexity. 

The present invention is not limited to the above 
embodiment where two types of videos are process- 



ed by two camera head units, and three or more types 
of video can be processed if the rate of the process 
of digital signal processing unit DSb is high enough. 
Furthermore, for several types of moving pictures 
which are forwarded for a television conference or the 
like, a still picture process can be carried out at high 
speed by the image memory to improve the efficien- 
cy of the entire process. 

An Image processing apparatus according to a 
fourteenth embodiment of the present Invention 
which is a digital camera will be described hereinafter 
with reference to the block diagram of Fig. 58. 

Referring to Fig. 58, an image processing appa- 
ratus includes a camera head unit CHR, and a digital 
signal processing unit DSR. Camera head unit CHR 
includes a ROM (Read Only Memory) 21. Digital sig- 
nal processing unit DSR includes a digital signal proc- 
essing circuit 14 and a serial ROMI/F22. 

Digital signal processing unit DSR is formed of a 
FPGA to program an arbitrary logic according to pro- 
gram data. Camera head CHR includes ROM 21 that 
holds program data for programming the FPGA logic 
circuit in digital signal processing circuit 14. Digital 
signal processing circuit 14 provides a clock CK to 
read out data to ROM 21 via serial ROMI/F22 when 
the power is turned on. Upon receiving clock CK, 
R0M21 provides to digital signal processing circuit 14 
program data PD which is serial data in synchroniza- 
tion with clock CK. Digital signal processing circuit 14 
forms an internal logic circuit according to the Input 
program data. The above-described operation is au- 
tomatically carried out by digital signal processing cir- 
cuit 14. When the programming of the internal logic 
circuit ends, digital signal processing circuit 14 attains 
an operating state to convert digital image signal 01 
output from camera head unit CHR into a video signal 
DP corresponding to a predetermined video method 
according to the program data stored In ROM 21 . The 
program data stored In ROM 21 Is generated by being 
automatically converted from a net list of the logic cir- 
cuit by a FPGA development device (not shown). 

A specific structure of the image processing ap- 
paratus of Fig. 58 will be described hereinafter. Each 
following embodiment can select a desired structure 
by modifying the program data stored in ROM 21 . Fig. 
59 is a block diagram showing a first specific example 
of the image processing apparatus of Fig. 58 for pro- 
viding a digital video signal of a color difference sys- 
tem. 

Referring to Fig. 59, an Image processing appa- 
ratus includes a camera head unit CHRa and a digital 
signal processing unit DSRa. Camera head unit 
CHRa includes an image sensing device 1, a pre- 
processing circuit 2, an A/D conversion circuit 3, a 
drive circuit 7, and a ROM 21a. Digital signal process- 
ing unit DSRa includes a digital signal processing cir- 
cuit 14a, a serial ROMI/F22, and a camera microconv 
puter24. Digital signal processing circuit 14a includes 
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a RBYt. separation circuit 141, a RBYl color process- 
ing circuit 142, a luminance signal processing circuit 
143, and a nnicrocomputer I/F23. 

RBYl separation circuit 141 separates and pro- 
vides a R signal, a B signal and a Yl signal (low fre- 
quency components of the luminance) from the digital 
image data output from A/D conversion circuit 3. 
RBYl color processing circuit 142 carries out a white 
balance control, a conversion into a color difference 
signal, specification of color difference gain, and the 
like on signals R, B, and Yl output from RBYl color 
separation circuit 141 to provide color difference sig- 
nals of R-Y and B-Y. Luminance signal processing cir- 
cuit 143 extracts luminance signal Y from the digital 
image signal output from A/D conversion circuit 3 to 
canry out a contour correction or the like. Camera mi- 
crocomputer 24 controls the white balance and the 
iris via microcomputer I/F23. 

The above-described RBYl separation circuit 
141, RBYl color processing circuit 142 and luminance 
signal processing circuit 143 are formed according to 
the logic circuit of digital signal processing circuit 14 
of the FPGA programmed by program data PD ap- 
plied from ROM 21a via serial ROMI/F22. By the 
above-described operation, the image processing ap- 
paratus of Fig. 59 provides digital video signals Y, R- 
Y and B-Y of the color difference system. 

A second specific embodiment of the image proc- 
essing apparatus of Fig. 58 will be described herein- 
after with reference to the block diagram of Fig. 60. 
The corresponding components in the image proc- 
essing apparatus of Fig. 60 and that of Fig. 59 have 
the same reference character denoted, and their de- 
scription will not be repeated. 

The image processing apparatus of Fig. 60 pro- 
vides a digital signal of a primary color system. In- 
stead of RBYl separation circuit 141 and RBY^ color 
processing circuit 142 shown in Fig. 59, a digital sig- 
nal processing circuit 14b of Fig. 60 includes a RGB 
separation circuit 147, a RGB color processing circuit 

148, and an adder 149. RGB separation circuit 147, 
RGB color processing circuit 148, and adder 149 are 
formed according to the FPGA logic circuit program- 
med by program data stored in ROM 21 b. 

RGB separation circuit 147 separates and pro- 
vides a R signal, a B signal, and a G signal from the 
digital image data output from A/D conversion circuit 
3. RGB color processing circuit 148 applies a white 
balance control, gain specification, and the like on 
the input RGB signal, which is then provided to adder 

149. Luminance signal processing circuit 143 ex- 
tracts luminance signal Y from the digital image data 
from A/D conversion circuit 3 to apply contour correc- 
tion thereon. The corrected luminance signal Y is pro- 
vided to adder 149. Adder 149 adds the color signals 
and the luminance signal to provide a digital video sig- 
nal of a RGB system. By the above-described opera- 
tion, a digital video signal of a primary color system 



is output from digital signal processing unit DSRa. 

A third specific example of the image processing 
apparatus of Fig. 58 will be described hereinafter with 
reference to the block diagram of Fig. 61. The conre- 
5 spending components in the image processing appa- 
ratuses of Figs. 61 and 59 have the same reference 
characters denoted, and their description will not be 
repeated. 

The image processing apparatus of Fig. 61 pro- 

10 vides a video signal of a composite system. In addi- 
tion to the components of the image processing ap- 
paratus of Fig. 59, the image processing apparatus of 
Fig. 61 includes an NTSC encoder 1 50. NTSC encod- 
er 150 modulates a video signal of a color difference 

15 system and outputs a video signal C DP of a compo- 
site system. RBYl separation circuit 141, RBYl color 
processing circuit 142, luminance signal processing 
circuit 143 and NTSC encoder 150 is formed accord- 
ing to the FPGA logic circuit programmed by the pro- 

20 gram data stored in ROM 21c. Therefore, the image 
processing apparatus of Fig. 61 can output a video 
signal of a composite system. 

The image processing apparatuses of Fig. 59-61 
are formed having digital signal processing circuit 14 

25 of the FPGA programmed by the program data stored 
in ROM 21. In other words, a video signal correspond- 
ing to three types of video systems can be output us- 
ing one FPGA. The image processing apparatus of 
the fourteenth embodiment can output a video signal 

30 corresponding to a desired video system without In- 
creasing circuit complexity. 

An image processing apparatus according to a 
fifteenth embodiment of the present invention will be 
described hereinafter with reference to the block dia- 

35 gram of Fig. 62. 

Referring to Fig. 62, an image processing appa- 
ratus includes a camera head CHRd, and a digital sig- 
nal processing unit DSR. Camera head unit CHRd in- 
cludes ROMs 21a-21c, and a select circuit 25. Digital 

40 signal processing unit DSR includes a digital signal 
processing circuit 14 and a serial ROMI/F22- 

Program data is stored in ROM 21a so that digital 
signal processing circuit 14 formed of a FPGA pro- 
vides a digital signal of a color difference system. Pro- 

45 gram data for providing a digital video signal of a pri- 
mary color system is stored in ROM 21b. Program 
data for providing a video signal of a composite sys- 
tem is stored in ROM 21c. Select circuit 25 selects 
one of ROMs 21a-21c. Select circuit 25 selects a vid- 

50 eo system corresponding to data set by a dip switch 
(not shown) provided in camera head unit CHRd, or 
according to an externally applied select signal. When 
the power is turned on, digital signal processing cir- 
cuit 14 reads out the program data from the selected 

55 ROM to form an internal logic circuit according to the 
logic of the program data. Then, digital signal proc- 
essing circuit 14 enters an operating state to provide 
a video signal of a predetermined video system ac- 

22 
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cording to the program data. By the above-described 
operation, a video signal corresponding to a desired 
video system can be output without increasing the cir- 
cuit complexity in the fifteenth embodiment. 

An image processing apparatus according to a 
sixteenth embodiment of the present invention will be 
described hereinafter with reference to the block dia- 
gram of Fig. 63. 

Referring to Fig. 63, an image processing device 
includes a camera head unit CHRe. and a digital sig- 
nal processing unit DSRe. Digital signal processing 
unit DSRe includes a digital signal processing circuit 
14 and a host I/F26. 

Camera head unit CHRe is similar that of camera 
head CHRa of Fig. 59 provided that ROM 21a is re- 
moved. Camera head unit CHRe converts image 
sensed light incident from an object into an electrical 
signal, and further converts that electrical signal into 
a digital image signal Di which is provided to digital 
signal processing unit DSRe. Digital signal process- 
ing unit DSRe includes a host I/F26 to transmit data 
with host device 27. For example, the programming 
data of the FPGA, a hand shake signal, and the like 
are provided from host device 27 to digital signal proc- 
essing circuit 14 via host I/F26. Digital signal process- 
ing circuit 14 formed of a FPGA has the internal logic 
circuit programmed according to program data from 
host device 27 to form an internal logic circuit corre- 
sponding to a desired video system similar to that of 
the first embodiment. Digital signal processing circuit 
14 converts the input digital image data DI into a dig- 
ital video signal DP corresponding to a predetermined 
video system according to the program data output 
from host device 27. 

A FPGA programming method of the image proc- 
essing apparatus of Fig. 63 will be described herein- 
after with reference to the flow chart of Fig. 64. 

When a chip select signal ICS (T implies a low 
active signal) attains an active state, digital signal 
processing circuit 14 formed of a FPGA fetches pro- 
gram data of 1 byte in response to a rise of a write 
strobe signal /WS. When this entry is completed, dig- 
ital signal processing circuit 14 renders /ACN signal 
to an active state. A digital signal processing circuit 14 
formed of a FPGA can have the internal logic circuit 
programmed according to the programming method 
shown in Fig. 64. 

At step S51 , the program memory of the FPGA is 
cleared. At step S52, chip select signal ICS is set to 
a L level to enter an active state. At step S53, write 
strobe signal /WS is set to a L level to become active. 
At step S54, program data is output from host device 
27. At step S55, write strobe signal / WS is set to a H 
level to enter an inactive state. At step S56, confirma- 
tion is made whether signal /ACN attains a L level or 
not. This confirmation operation is repeated until a L 
level is attained. When signal /ACN attains a L level, 
the process proceeds to step S57 where confirmation 



is made whether the transfer of program data from 
host device 27 has ended or not. If program data 
transfer has not ended, the program proceeds to step 
S53 where the subsequent process is continued. If 

5 program data transfer has ended, the program pro- 
ceeds to step S58 where chip select signal /CS is set 
to a H level and chip select signal /CS is set to an in- 
active state. At step S59, confirmation is made wheth- 
er the programming has ended or not. The conf irma- 

10 tion operation is repeated until the programming 
ends. When the programming ends, the process is 
completed. 

According to the above-described operation, host 
device 27 clears the FPGA programming memory be- 
ts fore data transfer. When data transfer ends, host de- 
vice 27 waits for a signal indicating the end of pro- 
gramming from the FPGA, and the programming op- 
eration is completed. 

According to the sixteenth embodiment, an inter- 

20 nal logic circuit of digital signal processing circuit 14 
formed of a FPGA is programmed according to pro- 
gram data output from an external host device, so that 
a logic Is established corresponding to a predeter- 
mined video system according to the program data. 

25 As a result, a video signal corresponding to a desired 
video system can be output on the basis of program- 
ming data output from host device 27 without increas- 
ing the circuit complexity. 

The present invention is not limited to the above- 

30 described sixteenth embodiment where only a host 
l/F is included, and a serial ROMI/F may further be in- 
cluded as in the fourteenth embodiment. When a 
ROM is included in a camera head unit, an internal 
logic circuit of a digital signal processing circuit can be 

35 programmed according to the program data in the 
ROM in the camera head unit A video signal accord- 
ing to a desired video system can be output according 
to an external host device and an internal ROM. 
An image processing apparatus according to a 

40 seventeenth embodiment will be described herein- 
after with reference to the block diagram of Fig. 65. 
The components in the image processing apparatus 
of Fig. 65 corresponding to those in the image proc- 
essing apparatus of Fig. 58 have the same reference 

45 characters denoted, and their description will not be 
repeated. 

Referring to Fig. 65, a digital signal processing 
circuit 14d further includes a register unit 28. In digital 
signal processing circuit 14d, data such as a coeffi- 

50 cient for correcting color reproduction in the color sep- 
aration circuit and for contour correction must be ini- 
tialized. Therefore, register unit 28 of digital signal 
processing circuit 14d includes a plurality of registers 
for setting such coefficients. These registers can 

55 have the register value set by providing an address 
signal, a data signal, and a strobe signal from the 
camera microcomputer. Therefore, an optimum ad- 
justment data can be obtained by varying the value 
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of the register at the time of adjustment, and modify 
the program data of the internal logic circuit of digital 
signal processing circuit 14d according to the ob- 
tained adjustment data. 

Modification of the register specification is de- 5 
scribed hereinafter. Figs. 66 and 67 are circuit dia- 
grams showing first and second structures of a reg- 
ister included in the register unit of Fig. 65. 

Referring to Fig. 66, a register includes an ad- 
dress decoder AD, an AND gate G1, and D flipflops 10 
L0-L3. 

A reset signal RS is applied to a set terminal SD 
of each of D flipflops L0-L3. Data TD0-TD3 are ap- 
plied to respective input terminals D of D flipflops LO- 
L3 via a data bus. An address signal AD is applied to 15 
address decoder AD via an address bus, and a de- 
code signal of address signal AD is applied to AND 
gate G1 . Also, a strobe signal STB is applied to AND 
gate G1. The output of AND gate 01 is applied to a 
clock terminal CK of each of D flipflops L0-L3. Reset 20 
terminals RD of D flipflops L0-L3 are connected to 
ground potential GND. Specification data D0-D3 
from the output terminals Q of D f llpflop L0-L3 are re- 
spectively provided. 

According to the above-described structure, the 25 
register shown in Fig. 66 is set to the initialization val- 
ue of "1111" of specification data D0-D3. 

Then, the structure of the register shown in Fig. 
66 is modified to the structure of the register shown 
in Fig. 67. As a result, the register of Fig. 67 has the 30 
value of specification data D0-D3 set to "1001". Pro- 
gram data corresponding to the above-described 
modification of the circuit structure is generated and 
stored in ROM 21 of camera head unit CHR. By ob- 
taining an optimum adjustment data during adjust- 35 
ment, and storing the obtained adjustment data in 
ROM 21, optimum initialization according to the char- 
acteristics of the camera head unit CHR Is carried out 
by the program data of ROM 21 . The Internal logic cir- 
cuit of digital signal processing circuit 14d Is progranv 40 
med, and initialization of each coefficient is carried 
out simultaneously. 

Because the above-described seventeenth enr»- 
bodiment has program data corresponding to the 
above-described adjustment data stored in ROM 21 45 
In camera head unit CHR, program data including the 
optimum adjustment data corresponding to the fea- 
ture of the image sensing device in camera head unit 
CHR can be provided at the camera head unit CHR 
side even if camera head unit CHR is exchanged. so 
Thus, optimum adjustment can be carried out even 
when camera head unit CHR is exchanged. 

An image processing apparatus according to an 
eighteenth embodiment of the present invention is de- 
scribed hereinafter with reference to the block dia- 55 
gram of Fig. 68. 

Referring to Fig. 68, an image processing appa- 
ratus Includes a camera head unit CHRf, and a digital 



signal processing unit DSRc. A camera head unit 
CHRf includes a ROM 21d. Digital signal processing 
circuit DSRc includes a FPGA 29, and a serial 
ROMi/F22. FPGA29 includes a digital signal process- 
ing circuit 14 and an image conversion circuit 30. 

Digital signal processing circuit 14 and Image 
conversion circuit 30 are formed of a FPGA 29 to have 
a predetermined logic established by programming 
the logic circuit of FPGA 29. The program data of 
FPGA 29 is stored In ROM 21d in camera head unit 
CHRf. More specifically, ROM 21 d stores the signal 
processing programming data for forming digital sig- 
nal processing circuit 14 and the format conversion 
programming data for forming image conversion cir- 
cuit 30. When the power Is turned on, FPGA 29 pro- 
vides to ROM 21d a clock CK for reading out data via 
serial ROMI/F22- ROM 21 d provides to FPGA 29 via 
serial ROMI/F22 program data PD which is seria! data 
in synchronization with the input clock CK. FPGA 29 
forms an internal logic circuit according to the input 
program data to program digital signal processing cir- 
cuit 14 and image conversion circuit 30 correspond- 
ing to the predetermined logic. The above-described 
operation is automatically carried out by FPGA 29. 

FPGA 29 enters an operating state when the pro- 
gramming of the internal logic circuit is completed. 
More specifically, digital signal processing circuit 14 
converts digital image signal Dl output from camera 
head unit CHRf into a video signal corresponding to 
a predetermined video system according to the signal 
processing program data stored In ROM 21 d. The in- 
verted video signal is output to Image conversion cir- 
cuit 30. Image conversion circuit 30 converts the Input 
video signal Into image data FD of a format corre- 
sponding to a predetermined format conversion sys- 
tem according to the format conversion program data 
stored in ROM 21 d. The data of ROM 21d is automat- 
ically converted and generated according to the net 
list of the logic circuit by a FPGA development device. 

A specific structure of the Image processing cir- 
cuit of Fig. 68 will be described hereinafter. In each of 
the following emt>odiments, an arbitrary structure 
can be selected by modifying the program data stored 
in R0M21d. 

Fig. 69 is a block diagram showing a structure of 
a first specific example of the innage processing ap- 
paratus of Fig. 68. The image processing apparatus 
of Fig. 69 converts a digital image signal into a digital 
video signal of a color difference system, and then 
converts the video signal into image data of a CIF for- 
mat. 

Referring to Fig. 69, an image processing appa- 
ratus Includes a camera head unit CHRg and a digital 
signal processing unit DSRd. Camera head unit 
CHRg Includes an image sensing device 1, a pre- 
scanning circuit 2, an A/D conversion circuit 3, a drive 
circuit 7, and a ROM 21e. Digital signal processing 
unit DSRd includes a FPGA 29a, a serial ROMI/F22. 
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and a camera microcomputer 24. FPGA 29a includes 
a digital signal processing circuit 14, a CIF conversion 
circuit 30a and a microcomputer I/F23. Image sensing 
device 1 is a CCD of 320000 pixels. ROM 21 e stores 
signal processing program data for fonming digital sig- 
nal circuit 14 that outputs a digital video signal of a 
color difference system and an image conversion 
program data for forming a CIF conversion circuit pro- 
viding an image data of a CIF format. FPGA 29a pro- 
grams the internal circuit according to the program 
data stored in ROM 21 e via serial ROMI/F22, and 
forms a RBYl separation circuit 141, a RBYl color 
processing circuit 142, a luminance signal processing 
circuit 143, and a CIF conversion circuit 30a. Similar 
to the image processing apparatus of Fig. 59, the 
present digital signal processing circuit 14 converts 
digital image data into a digital video signal of a color 
difference system, and provides the same to CIF con- 
version circuit 30a. CIF conversion circuit 30a con- 
verts the digital video signal of a color difference sys- 
tem into image data of a CIF format 

The case of a CIF format conversion will be de- 
scribed when an image sensing device 1 of 320000 
pixels is used. The number of pixels of image sensing 
device 1 Is 512(h) x 582(v). According to drive circuit 
7, non-interlace read out is carried out from image 
sensing device 1. The non-interlace read out signal is 
converted into a video signal of a color difference sys- 
tem by pre-scanning circuit 2, A/D conversion circuit 
3, and digital signal processing circuit 14. As a result, 
luminance data Y, color data (dot sequential color dif- 
ference) R-Y, and B-Y of 512(H) x 291 (V) pixels are 
obtained. The obtained luminance data Y and color 
data R-Y and B-Y are converted into image data CIF 
of a CIF format of the resolution of 352(H) x 288(V) by 
CIF conversion circuit 30a. 

A second specific example of the image process- 
ing apparatus of Fig. 68 will be described hereinafter 
with reference to the block diagram of Fig. 70. The im- 
age processing apparatus of Fig. 70 converts digital 
image data into a digital video data of a color differ- 
ence system, and converts the same further into im- 
age data of a VGA (Video Graphic Array) fonmat. 

The image processing apparatus of Fig. 70 dif- 
fers from that of Fig. 69 in that the number of pixels 
of the image sensing device is changed from 320000 
to 410000, CIF conversion circuit 30a is modified to 
a VGA conversion circuit 30b, and R0M21e storing 
signal processing program data corresponding to a 
video signal of a color difference system and image 
conversion programming data is modified to a ROM 
21f storing signal processing program data corre- 
sponding to a video signal of a color difference sys- 
tem and an image conversion program data corre- 
sponding to a VGA format. The remaining compo- 
nents are similar to those of the image processing ap- 
paratus of Fig. 69 which have the same reference 
characters denoted. Their description will not be re- 



peated. 

FPGA 29b receives program data PD from ROM 
21f via serial ROMI/F22 to program the Internal logic 
circuit, and forms a video signal processing circuit 14 

5 that provides a video signal of a color difference sys- 
tem and a VGA conversion circuit 30b that provides 
image data of a VGA format. A signal read out from 
image sensing device 1b by drive circuit 7 is convert- 
ed into digital image data Dl by pre-processing circuit 

10 2 and A/D conversion circuit 3, and then converted 
into luminance data Y and color data R-Y and B-Y of 
768(H) X 247(V) by digital signal processing circuit 32 
to be provided to VGA conversion circuit 30b, VGA 
conversion circuit 30b removes the top 4 lines and the 

15 . bottom 3 lines in the vertical direction, and reduces 12 
dots to 10 dots in the horizontal direction, and pro- 
vides image data VGAof a 640(H) x 480(V) resolution 
corresponding to a VGA format. 

According to the above-described eighteenth 

20 embodiment, a digital signal processing circuit corre- 
sponding to a desired video system and an image 
conversion circuit corresponding to a desired image 
conversion system can be formed by a FPGA to pro- 
vide a video signal corresponding to a desired video 

25 system and image conversion system without in- 
creasing the circuit complexity. When image format is 
to be converted using an image sensing device dif- 
fering in the number of pixels, a ROM storing program 
data corresponding to a desired image conversion 

30 system is provided in a camera head, so that ex- 
change of an image sensing device and modification 
of the logic circuit of an image format conversion cir- 
cuit can be carried out simultaneously by just ex- 
changing a camera head unit 

35 Although the present invention has been descri- 

bed and illustrated in detail, it is clearly understood 
that the same is by way of illustration and example 
only and is not to be taken by way of limitation, the 
spirit and scope of the present invention being limited 

40 only by the terms of the appended daims. 



Claiins 

45 1. An image processing apparatus comprising: 

Image signal output means (1-3) for con- 
verting image sensed light incident from an ob- 
ject into a digital image signal, 

signal processing means (4) for applying a 
so signal process on said digital video signal to out- 
put a digital video signal, and 

conversion means (5) for converting sakl 
digital video signal into image data corresponding 
to a predetermined image format and outputting 
55 the same. 

2. The image processing apparatus according to 
claim 1 , wherein said image processing appara- 
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tus comprises detection means (9) for detecting 
the feature of an image from said digital video 
signal, 

wherein said image conversion means 
carries out an image format conversion according 5 
to the feature of an image detected by said detec- 
tion means. 

3. The image processing apparatus according to 
dalm 1 , wherein said conversion means compris- io 
es 

first conversion means (57) for converting 
said digital video signal into image data corre- 
sponding to a GIF format of 352 dots x 288 lines, 
and 15 

second conversion means (58) for receiv- 
ing said Image data corresponding to the GIF for- 
mat output from said first conversion means for 
converting said Image data corresponding to the 
GIF format into image data corresponding to an- 20 
other format, 

said second conversion means selectively 
providing one of said image data corresponding 
to the GIF format and corresponding to the other 
format 25 

4. The image processing apparatus according to 
daim 3, wherein said second conversion means 
comprises 1/2 conversion means (58) for con- 
verting said image data corresponding to the GIF 30 
format into image data that is 1/2 in a horizontal 
direction and a vertical direction, and providing 
image data corresponding to a QGIF format of 

176 dots X 144 lines. 

35 

5. The image processing apparatus according to 
daim 1, wherein said conversion means compris- 
es 

vertical conversion means (61) for receiv- 
ing said digital video signal for carrying out con- 40 
version on the vertical direction of said image 
data corresponding to the predetermined Image 
format, and 

horizontal conversion means (62) con- 
nected in series to said vertical conversion 45 
means for carrying conversion on the horizontal 
direction of said image data corresponding to the 
predetermined image format, 

wherein said vertical conversion means 
provides expanded image data having scanning so 
lines expanded by interpolating said digital video 
signal and providing an expanded data control 
signal for indicating a valid timing of said extend- 
ed image data when the number of scanning lines 
of said digital video signal is smaller than that of 55 
said image data corresponding to the predeter- 
mined image format. 



6. The image processing apparatus according to 
claim 1 , wherein said conversion means compris- 
es 

vertical conversion means (61) receiving 
said digital video signal for carrying out conver- 
sion on the vertical direction of said image data 
corresponding to the predetermined image for- 
mat, and 

horizontal conversion means (62) con- 
nected in series to said vertical conversion 
means for carrying out conversion on the hori- 
zontal direction of said image data corresponding 
to the predetermined image format, 

wherein said horizontal conversion means 
provides compressed image data having said 
digital video signal compressed in the horizontal 
direction and provides compressed data control 
signal indicating the valid timing of said com- 
pressed image data when the number of dots of 
said digital video signal in the horizontal direction 
is greater than that of said image data corre- 
sponding to the predetermined image format. 

7. The image processing apparatus according to 
claim 6, further comprising: 

data control means (624-627) responsive 
to said compressed data control signal for se- 
quentially storing said compressed image data, 
and providing said stored compressed image 
data when 1 line of said compressed image data 
is obtained. 

8. The image processing apparatus according to 
claim 1 , wherein said conversion means compris- 
es square pixel conversion means (5c) for con- 
verting said digital video signal into image data of 
a format corresponding to a square pixel. 

9. The image processing apparatus according to 
claim 8, wherein said square pixel conversion 
means comprises 

first conversion means (65) for converting 
said digital video signal output from said signal 
processing means into image data of a first for- 
mat corresponding to said square pixel, 

second conversion means (66) for con- 
verting said image data of the first format into im- 
age data of a second format in which the number 
of lines and the number of dots are 1/2, 

third conversion means (67) for converting 
said image data of the second format into image 
data of a third format In which the number of lines 
and the number of dots are 1/2, and 

conversion operation control means (68) 
responsive to a fonnat specification signal for 
specifying a conversion format for controlling the 
conversion operation of said first to third conver- 
sion means. 
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10. The image processing apparatus according to 
daim 9, wherein said square pixel conversion 
means further comprises contour enhancement 
means (69) for enhancing the contour of convert- 
ed Image data. 

11. The image processing apparatus according to 
daim 9, wherein said signal processing means 
outputs said digital video signal in synchroniza- 
tion with a predetermined clock signal, 

wherein said first conversion means com- 
prises 

first image data conversion means (63) for 
converting said digital video signal input in syn- 
chronization with said dock signal into image 
data of said first format, and outputting said im- 
age data of the first format in synchronization 
with said clock signal and 

first timing signal generation means (64) 
for generating a first timing signal indicating the 
valid timing of said image data of the first format, 

wherein said second conversion means 
comprises 

second Image data conversion means 
(66) for con verting said Image data of the first for- 
mat Input in synchronization with said clock signal 
into Image data of the second format, and output- 
ling said Image data of the second format in syn- 
chronization with said clock signal, and 

second timing signal generation means 
(66) for generating a second timing signal indicat- 
ing the valid timing of said Image data of the sec- 
ond format, 

wherein said third conversion means com- 
prises 

third Image data conversion means (671- 
674) for converting said Image data of the second 
format input in synchronization with said dock 
signal Into image data of the third format, and out- 
putting said image data of the third format in syn- 
chronization with said clock signal, 

third timing signal generation means (675, 
676) for generating a third timing signal Indicating 
the valid timing of said image data of the third for- 
mat. 

12. The Image processing apparatus according to 
daim 11, wherein said second image data con- 
version means selects Image data of one of an 
odd number and an even number field of said inv 
age data of the first format, for converting the 
number of lines to 1/2, 

wherein said third image data conversion 
means comprises horizontal calculation means 
(674) for converting the number of dots in the hor- 
izontal direction of said image data of the second 
format to 1/2 by a calculation process, 

wherein said horizontal calculation means 



selects either image data of two adjacent dots or 
image data of two dots spaced apart by 1 dot. 

13. The image processing apparatus according to 

5 claim 11, wherein said third image data conver- 

sion means comprises 

horizontal calculation means (677) for con- 
verting the number of dots in the horizontal direc- 
tion of said image data of the second format to 1/2 

10 by a calculation process, 

a line memory (679) for storing image data 
having the number of dots In the horizontal direc- 
tion converted to 1/2 by said horizontal calcula- 
tion means, and 

15 vertical calculation means (674) for con- 

verting the number of lines in the vertical direc- 
tion of said image data of the second format to 1/2 
by carrying out a calculation process on the Im- 
age data output from said horizontal calculation 

20 means and said line memory. 

14- The image processing apparatus according to 
claim 13, wherein said first format comprises a 
VGA format of a resolution of 640x480 dots. 

25 

15. The image processing apparatus according to 
claim 1 , wherein said conversion means compris- 
es 

Image conversion logic means (12) that 
30 can have an arbitrary logic programmed, and 

program means (13) for programming a 
predetermined logic In said image conversion 
logic means, 

wherein said Image conversion logic 
35 means converts said digital video signal into Im- 

age data corresponding to a predetermined Im- 
age format according to said predetermined logic 
programmed by said programming means, and 
outputs said image data. 

40 

16. The image processing apparatus according to 
claim 15, further comprising: 

detection means (9) for detecting a feature 
of an Image from said digital video signal, 

45 wherein said program means determines 

an Image format conversion process according to 
said feature of the image for programming a pre- 
determined logic realizing said image format con- 
version process in said Image conversion logic 

50 means, 

wherein said Image conversion logic 
means carries out said image format conversion 
process on said digital video signal output from 
said signal processing means according to said 

55 predetermined logic programmed by said pro- 

gram means, and outputs said Image data corre- 
sponding to said image format 
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digital video signal of a moving picture output 
from said moving picture output means attains a 
blanking period, and for controlling said select 
means such that said digital image signal of a 
5 moving picture output from said moving picture 

output means is output, and for controlling said 
program means such that a signal process and an 
image format conversion process that suits said 
digital image signal of a moving picture output 
10 from said moving picture output means are pro- 

grammed in said signal process logic means and 
said image conversion logic means. 

20. The image processing apparatus according to 
15 claim 1 5, wherein said image processing appara- 

tus further comprises: 

memory means (21 d) for storing signal 
process program data corresponding to a prede- 
termined video system and image conversion 
20 program data corresponding to a predetermined 

image conversion system, 

wherein said signal processing means 
comprises signal processing logic means that 
can have an arbitrary logic programmed, 
25 wherein said image processing apparatus 



17. The image processing apparatus according to 
daim 15, wherein said signal processing means 
comprises signal processing logic means (14) 
that can have an arbitrary logic programmed, 

wherein said program means programs a 
predetermined logic in said signal processing log- 
ic means and said image conversion logic means 
according to an externally input control data. 

18. The image processing apparatus according to 
daim 17, wherein said image signal output 
means comprises image sensing means (1) hav- 
ing a predetermined resolution, 

wherein said control data comprises data 
concerning the resolution of said image sensing 
means, 

wherein said program means programs a 
predetermined logic according to the resolution of 
said image sensing means In said signal process- 
ing logic means and said image conversion logic 
means, 

wherein said signal processing logic 
means can-ies out a signal process according to 
the resolution of said image sensing means, 

wherein said image conversion logic 
means carries out an image format conversion 
process according to the resolution of said image 
sensing means. 

19. The image processing apparatus according to 30 
daim 15, wherein said image signal output 
means comprises 

still picture output means (CHa) for provid- 
ing a digital image signal of a still picture, and 

a moving picture output means (CHb) for 35 
providing a digital video signal of a moving pic- 
ture, 

wherein said image processing means fur- 
ther comprises 

select means (18) for selectively output- 40 
ting one of said digital image signal of a moving 
picture output from said moving picture output 
means and said digital image signal of a still pic- 
ture output from said still picture output means, 

wherein said signal processing means 45 
comprises signal processing logic means (14) 
that can have an arbitrary logic programmed. 

wherein said image processing apparatus 
further comprises control means (19) for control- 
ling said select means such that said digital video 50 
signal of a still picture provided from said still pic- 
ture output means is output, and for controlling 
said program means such that a signal process 
and an image format conversion process that 
suits said digital image signal of a still picture out- 55 
put from said still picture output means are pro- 
grammed in said signal process logic means and 
said image conversion logic means when said 



is separated into an image sensing unit including 
said image signal output means and said memory 
means, and a signal processing unit induding 
said signal processing logic means, said image 
conversion logic means, and said program 
means. 

wherein said image processing apparatus 
further comprises: 

transfer means for transferring said pro- 
gram data from said image sensing unit to said 
signal processing unit, 

wherein said signal processing logic 
means has a predetermined logic programmed 
according to said signal processing program data 
stored in said memory means for converting said 
digital image signal into a digital video signal cor- 
responding to a predetermined video system and 
outputting said digital video signal, 

wherein said image conversion logic 
means has a predetermined logic programmed 
by said image conversion program data stored in 
said memory means for converting said digital 
video signal output from said signal processing 
logic means into image data of a format corre- 
sponding to said predetermined image conver- 
sion system. 

21. An image processing apparatus comprising: 

image signal output means (1-3) for con- 
verting image sensed light incident from an ob- 
ject into a digital image signal and outputting said 
digital image signal, 

memory means (21) for storing program 
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56 



data corresponding to a predetermined video 
system, and 

signal processing logic means (14) that 
can have an arbitrary logic programmed, 

wherein said signal processing logic 5 
means has a predetermined logic programmed 
according to said program data stored in said 
memory means for converting said digital image 
signal into a digital video signal con-esponding to 
said predetermined video system. io 

22. The image processing apparatus according to 
daim 21 , wherein said memory means comprises 
a plurality of memory means (21a-21c) for storing 
program data corresponding to different video i5 
systems, 

wherein said image processing apparatus 
further comprises select means (25) for selecting 
a predetermined memory means from said plur- 
ality of memory means to output the program 20 
data stored in said selected memory means to 
said signal processing logic means. 



means has a predetermined logic programmed 
according to program data input from said exter- 
nal device via said input means for converting 
said digital image signal into a digital video signal 
corresponding to the predetermined video sys- 
tem. 

26. An image processing apparatus comprising proc- 
essing means which receives a digital image sig- 
nal and processes the same at least to convert 
the image format, characterised in that said proc- 
essing means is programmable for selecting at 
least one of the input and output image formats 
of the conversion. 

27. An image processing apparatus according to 
claim 26, comprising an image sensing unit which 
provides said digital image signal and a signal 
processing unit which includes said processing 
means, wherein said image sensing unit includes 
storage means storing programming data for the 
processing means. 



23. The image processing apparatus according to 
daim 21, wherein said image signal output 25 
means comprises image sensing means (1) for 
converting said image sensed light into an elec- 
tric signal, 

wherein said memory means stores pro- 
gram data including adjustment data determined 30 
at the initial adjustment of said image sensing 
means. 

24. The image processing apparatus according to 
daim 23, wherein said image processing appara- 35 
tus is separated into an image sensing unit (CHR) 
induding said image signal output means and 

said memory means, and a signal processing unit 
(DSRb) including said signal processing means 
and sard program means, 40 

wherein said image processing apparatus 
further comprises transfer means (22) for trans- 
ferring said program data including adjustment 
data from said image sensing unit to said signal 
processing unit. 45 



28. An image processing apparatus according to 
claim 26 or claim 27, comprising means for cate- 
gorising the image type, for example as moving 
picture, still picture or text, and means for supply- 
ing programming data to said processing means 
according to the established image category. 

29. An image processing apparatus according to 
claim 27 or claim 28, wherein said programming 
data includes data identifying the image format of 
said digital image signal. 

30. An image processing apparatus according to any 
of claims 26 to 29, wherein said processing 
means comprises programmable logic circuitry. 



25. An image processing apparatus comprising: 

image signal output means (CHRe) for 
converting image sensed light Incident from an 
object into a digital image signal and outputting 50 
said digital image signal, 

input means (26) for inputting into said inrv 
age processing apparatus program data corre- 
sponding to a predetermined video system input 
from an external device (27), and 55 

signal process logic means (14) that can 
have an arbitrary logic programmed, 

wherein said signal processing logic 
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